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sample  of  approximately  700  support,  management,  and  bench  level 
Individuals  engaged  in  Defense  research,  development,  test,  and 
evaluation  (RDT&E)  activities.  Twenty  five  organizations  from 
each  of  four  DDC  user  organization  categories  were  drawn  randomly 
from  the  DoO  Dissemination  Authority  List  (DAL).  The  four 
categories  are:  DoD  Key  Users,  DoD  Non-Key  Users,  Contractor  Key 

Users^  Contractor  Non-Key  Users. 

The  survey  strategy  combined  the  advantages  and  economy  of  mailing 
and  the  Insurability  of  response  was  provided  by  telephone  contact. 
The  mailed  package  Included  a set  of  cards  which  listed  acceptable 
responses  for  questions.  In  this  way  questions  asked  over  the 
telephone  could  be  answered  as  multiple  choice.  The  cards  containing 
the  choices  were  not  Identifiable  In  terms  of  the  questions  prior 
to  the  telephone  Interview  to  preclude  discussion  with  colleagues 
or  research  for  answers. 
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2.  DESCRIPTION  OF  THE  SURVEY  PLAN 


(1)  Prospective  user  survey  participants  will  be  selected  randomly  by  a 

sampling  from  each  of  the  categories  (strata)  shown  In  Figures  1 and  2.  In  each 
user  category,  a specified  number  of  members  --  the  sample  size  for  the  stratum 
will  be  selected  at  random  by  the  following  method.  AUERBACH  and  CDA  have 
devised  a unique  methodology  for  drawing  the  sample.  It  had  been  anticipated 
that  It  would  be  possible  to  select  individual  users  randomly  from  DDC  records. 
These  records,  however,  were  not  adequate  for  this  purpose,  because  in  all  too 
many  cases  a librarian  signs  for  the  services  instead  of  the  real  user.  Hence, 
an  alternative  methodology  was  developed,  consisting  of  the  following  steps: 

(a)  Twenty-five  user  organizations  from  each  of  the  four  user 

organization  categories  were  drawn  randomly  from  the  Department 
of  Defense  Dissemination  Authority  List  (DAL) . The  four 
categories  are:  DoD  key  users,  DoD  non-key  users,  contractor 

key  users  and  contractor  non-key  users. 

(b)  The  following  criteria  were  utilized  to  determine  a code 
number  representing  a user  organization  that  would  be  Included 
In  the  sample: 

A.  The  organization  must  be  engaged  In  some  form  of  R,D,T,  or  E 

B.  The  interview  must  be  carried  out  in  a RDT&E  environment  or 
in  an  environment  of  RDT&E  management. 

C.  A contractor  organization  must  be  a DoD  contractor  In  order 
to  be  Included.  (NASA  and  ERDA  contractors  also  appear  In 
the  DAL) . 


Formulate  a definitive  set  of  time  phased  development 
efforts  to  satisfy  user  population  S&Tl/RDT&E  manage- 
ment information  requirements  during  1978-1988  and  to 
rectify  problem  areas  identified. 


(e)  Describe  DDC's  role  in  the  1978-1988  S&TI  and  RDT&E 
management  information  community. 


Definition  of  the  information  needs  and  problems  of  technical 
and  management  members  of  the  DoD  RDT6cE  community  is  Indispensable  to  the 
accomplishment  of  these  objectives.  Accordingly,  a significant  phase  of 
this  study  is  the  design  and  conduct  of  a survey  of  users  and  potential  users 

I 

of  DDC  supplied  information  to  determine  their  use  of,  needs  for,  and  views 
regarding  the  adequacy  of  both  current  and  future  DDC  information  products 
and  services. 


(2)  Data  from  this  survey  will  be  analyzed  by  AUERBACH  Associates  to 
ascertain  representative  current  and  projected  Information  needs  and  problems 
of  DoD  RDT&E  Personnel.  The  results  will  provide  significant  input  to  the 
contractor's  recommendations  for  facilitating  the  transfer  of  S&TI  and  RDT&E 
management  information  for  the  1978-1988  period. 

(3)  Data  of  the  kind  to  be  obtained  from  this  survey  are  not  presently 
available. 


Users 
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D.  The  contractor  must  have  a current  DoD  contract  at  the 
time  of  the  survey. 

E.  The  organization  must  be  in  the  continental  U.S. 

F.  The  organization  must  be  in  DoD  or  be  a Defense  contractor. 
Other  government  agencies  (e.g.,  NASA,  Coast  Guard,  etc.) 
are  excluded  from  the  survey. 

(c)  Interviewers  will  then  contact  the  focal  point  in  each  organiza- 
tion. This  "focal  point"  is  the  person  listed  In  the  DAL. 

After  determining  If  this  "focal  point"  is  the  support  person  in 
charge  of  the  library  and/or  scientific  Information,  the  interviewer 
asks  this  support  person  if  he  has  a file,  list  or  directory  of 
persons  In  his  organization.  From  this  point  names  are  drawn 
randomly  from  a randomized  alphabetic  list  based  on  a combination 
of  random  numbers  and  codified  list  of  name  sterns.^  Interviewers 
have  been  trained  In  sampling  methodology  and  several  pilot  phone 
calls  were  made  to  work  out  the  "bugs"  In  this  procedure. 

(2)  The  proposed  study  requirements  can  best  be  met  by  a survey  strategy 

which  Includes  both  mail  and  telephone  surveys.  This  strategy  will  combine  the 
advantages  and  the  economy  of  mailing  and  the  insurability  of  response  pro- 
vided by  telephone  contact.  First,  potential  respondents  will  be  contacted  by 
telephone  and  solicited  for  their  participation  in  the  study.  Should  they 
agree,  a date  for  the  telephone  interview  will  be  established,  along  with  one 
alternative  date.  Following  this  contact,  a pre-packaged  set  of  materials  will 
be  sent  to  the  respondent,  including  a set  of  cards  (see  Appendix  C)  which  de- 
tail the  acceptable  responses  for  the  designated  questions.  In  this  way, 
questions  that  are  asked  over  the  telephone  may  be  answered  in  a multiple 
choice  format,  because  the  respondent  will  have  the  various  response  alterna- 
tives before  him  at  the  time  of  the  phone  call.  The  cards  which  contain 
the  response  alternatives  will  not  be  identifiable  in  terms  of  the  questions 
prior  to  the  telephone  interview,  so  that  respondents  will  not  be  able  to 
discuss  the  questions  with  their  colleagues,  nor  will  they  be  able  to  devise 
answers  prior  to  the  time  of  the  interview. 


C.  A.  Cutter's  Cutter-Sanborn  Three-Figure  Author  Table,  distributed  by  the 
H.  R.  Huntting  Company 
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In  addition  to  the  response  cards,  each  interviewee  will  receive 
a descriptive  cover  letter,  confirming  the  respondent's  intent  to  participate, 
and  a Privacy  Act  Statement  informing  each  individual  of  his  response  alterna* 
tives  under  the  Federal  Privacy  Act  of  1974.  The  letter  will  Include  a 
reaffirmation  of  the  dates  and  times  (primary  and  alternate)  established  for 
his  telephone  interview.  A copy  of  the  cover  letter  appears  in  Appendix  D. 

In  order  to  provide  insights  about  the  various  categories  of  users 
and  potential  users,  we  propose  to  stratify  the  population  and  sample  sufficient 
numbers  in  each  category  to  make  the  results  obtained  in  each  category 
reliable.  Since  the  use  of  the  telephone  guarantees  response,  the  stratified 
sample  need  not  be  larger  that  that  which  would  be  used  for  personal  interviews. 

Pretesting  began  in  July  during  the  first  month  of  the  study,  so  that 
the  results  could  be  submitted  to  the  0MB  clearance  process  at  the  earliest 
possible  date.  The  interview  schedule  that  will  be  used  (see  Appendices  A & B) 
is  structured  so  that  coded  and  quantifiable  responses  will  result.  There  is 
also  enough  latitude  to  permit  the  writing  in  of  responses  and  ampliflciation 
via  comments.  Our  goal  is  to  use  only  the  minimum  number  of  questions  needed 
to  elicit  the  required  information,  and  generally  to  make  the  interview  as  easy 
as  possible  to  quantify  in  order  to  (a)  minimize  the  interviewer  training 
effort;  (b)  adapt  it  to  the  telephone  medium;  and  (c)  facilitate  statistical 
analysis.  The  objective  will  be  to  maximize  the  response  rate  without  sacrific- 
ing interview  effectiveness. 

The  interview  schedule  for  bench  level  scientists  and  managers  of 
RDT6iE  activities  (Appendix  A)  covers  the  following  basic  areas: 

Identification  of  information  requirements 

Identification  of  the  current  S&TI  and  RDT&E  management 
information  environment 

Identification  of  current  problems  associated  with  information  use 
Identification  of  respondent  search  strategies 
Futuristic  projections  of  requirements 


Aside  from  bench  level  and  managerial  )>crsonnel,  "support  personnel" 
will  be  included  in  the  sample  to  be  surveyed.  These  support  personnel  consist 
of  on-line  terminal  operators,  technical  librarians,  and  individuals  who  provide 
information  support  within  DoD  and  Defense  contractor  organizations.  They  have 
been  included  in  the  sample  to  be  surveyed  as  a source  of  voluable  insight  into 
present  and  projected  technical  information  exchange  within  the  Defense  community. 
A separate,  but  analogous  interview  schedule  has  been  prepared  for  administration 
to  this  stratum  of  the  survey  sample  (see  Appendix  B) . 

The  interview  schedule  will  focus  on  the  response  time,  quantity, 
quality,  medium,  format  and  degree  to  which  information  received  is  up  to 
date.  Questions  will  concentrate  on  the  user's  viewpoint  toward  information 
provided  by  DDC  and  other  major  information  sources  and  reasons  for  his  dis- 
satisfaction and/or  satisfaction.  The  interview  will  elicit  future  needs 
as  well  as  a description  of  current  problems.  i 

Prior  to  the  Interview,  but  following  the  initial  telephone 
contact,  a letter  will  be  mailed  to  the  subject  in  which  his  cooperation 
on  the  project  is  explained.  This  letter,  which  is  shown  in  Appendix  D will 
also  insure  the  respondent  of  the  confidentiality  of  the  information  that  is 
being  gathered.  The  letter  will  also  reaffirm  the  dates  for  the  telephone 
interview. 


The  interview  is  designed  to  elicit  information  on  the  sources  that 
are  currently  used  to  meet  information  requirements.  In  addition,  it  will 
also  solicit  responses  concerning  how  well  these  needs  are  met  by  the  sources 
that  have  been  or  are  being  used.  Responses  to  questions  are  structured  in 
terms  of  choice  such  as;  poor,  fair,  good,  excellent,  outstanding,  in  order 
to  make  quantitative  analysis  of  these  responses  possible.  In  addition,  the 
questionnaire  provides  for  amplifying  remarks  to  supplement  the  structured 
responses , 


Another  area  of  inquiry  will  involve  questions  about  improvement 
to  DDC  information  resources.  Respondents  will  be  asked  to  indicate  how  these 
resources  might  be  made  more  useful  to  them.  The  interview  also  solicits 
respondents*  perceptions  about  feedback  mechanisms  for  DDC  information  --  that 
is,  do  they  transmit  any  feedback  to  DDC  and  do  they  feel  there  are  adequate 
means  for  making  their  needs  and  suggestions  for  Improvement  known  to  DDC? 


r 
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The  preliminary  interview  schedule  was  submitted  to  the  DDG  Project 
Officer  for  review  and  discussion  before  pretesting  was  attempted.  Necessary 
changes  have  been  Incorporated  in  the  attached  interview  schedule. 

After  the  Project  Officer  approved  the  inteiview  schedules,  and 
after  modifications  were  made,  a small  sample  of  two  users  was  pretested. 

The  pretest  sample  was  selected  with  Project  Officer  approval.  Preliminary 
contacts  were  made  with  members  of  this  group  and  the  preliminary  package  was 
mailed  to  the  respondents.  This  pretest  allowed  us  to  detect  and  correct 
problems  in  the  interview.  Problems  occurring  with  any  aspect  of  the  Interview 
schedule  and/or  the  associated  instructions  were  noted,  then  reviewed  by  the 
survey  team.  In  addition,  the  revised  Interview  schedules  were  reviewed  by  a 
task  force  at  DDC  and  selected  key  support  personnel.  Based  on  the  pilot 

interviews  and  this  additional  review  process,  proposed  revisions  in  the  inter- 

\ 

view  schedules  were  reviewed  with  the  DDC  Project  Officer.  Approved  revisions 

were  incorporated  into  the  final  version  of  the  Interview  schedules  presented 
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in  Appendices  A & B. 

The  sampling  plan  has  been  developed  in  close  coordination  with  the 
Project  Officer,  to  ensure  that  it  is  consistent  with  DDC  objectives.  The 
plan  discussed  below  has  been  modified  based  on  comments  provided  by  the 
Project  Officer  and  from  insights  obtained  during  the  pretesting.  The  sampling 
plan  requires:  (a)  identification  and  categorization  of  the  population;  and 

(b)  selection  of  respondents. 

Four  populations  will  be  considered  for  sampling  purposes  in  this 
study:  (1)  the  key  DoD  organizations;  (2)  all  the  remaining  DoD  organiza- 

tions; (3)  key  contractor  organizations;  and  (A)  all  the  remaining  contractor 
organizations.  Random  sampling  will  be  conducted  within  each  of  these  popula- 
tions. Bench  level  users,  support  personnel  and  management  personnel  will  be 
selected  from  each  population.  A larger  number  of  personnel  within  some 
facilities  will  necessitate  the  use  of  a sampling  fraction;  that  fraction 


"Jiey"  organizations  have  been  defined  by  DDC  as  the  top  200  requesters  of 
DDC  documents,  by  volume  of  requests. 
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to  be  decided  upon  by  the  number  of  personnel  within  each  relevant  population. 

This  information  will  be  gathered  from  the  focal  point  in  the  initial  telephone 
contact. 

Proportionate  sampling  will  take  place  within  each  of  the  two  DoD 
populations  and  within  the  two  contractor  populations,  where  groups  of  bench 
level  users  and  management  personnel  will  be  randomly  sampled  from  within  each 
population.  In  addition,  AUERBACH  has  added  the  sub  stratum  of  support  personnel, 
which  includes  technical  librarians,  search  and  retrieval  specialists,  etc. 

Again,  these  sub  populations  will  be  subjected  to  proportionate  random  sampling; 
the  sampling  fraction  to  be  determined  on  the  basis  £ the  total  number  of. 
persons  within  each  category.  At  this  point,  wit'  it  knowledge  of  the  numbers 
of  persons  within  each  defined  category  it  is  no,  possible  to  determine  the  N 
within  each  relevant  dimension. 

I 

We  ure  prepared  to  conduct  a maximum  of  800  and  a minimum  of  650 

Interviews,  based  upon  the  numbers  that  fall  within  each  category.  The 

estimated  accuracy  of  the  results  for  percentages  are  + 5 percentage  points, 
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with  a confidence  level  of  95%.  This  means  that  if  the  project  were  repeated 
100  times,  the  results  would  fall  within  5 percentage  points  at  least  95  times 
out  of  100.  Since  this  project  will  be  at  least  partially  concerned  with  dif- 
ferences between  sub  categories  of  respondents,  the  accuracy  for  differences 
may  increase  the  estimate  of  error  approximately  2 percentage  points.  Never- 
theless, since  both  cost  and  time  are  relevant  considerations,  AUERBACH  feels 
that  this  small  percentage  of  error  can  be  tolerated  in  the  Interest  of 
feasibility  and  practicality. 

Prior  to  tabulating  the  data  from  survey  responses,  we  will  screen 
and  edit  completed  interviews  for  completeness,  internal  consistency  and  other 
factors  that  would  affect  data  quality.  Write-in  answers  to  unstructured  and 
semi- structured  questions  will  be  coded  by  our  survey  project  team  to  assure 
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Yates,  Frank.  Sampling  Methods  for  Census  and  Surveys.  London;  Charles 
Griffin  and  Company,  Ltd.,  1949 


reliability  and  to  facilitate  analysis  and  summarization  of  these  kinds  of 
responses.  In  order  to  assure  complete  accuracy  and  reliability  of  interview 
data,  4%  of  the  interviews  in  each  major  category  will  be  randomly  selected 
for  telephone  monitoring.  For  each  of  these  selected  interviews,  a senior  pro- 
ject team  member  will  monitor  the  interview  while  in  progress  and  record  all 
of  the  respondent's  answers.  Systematic  comparisons  will  be  coordinated  with 
the  interviewer,  and  interjudge  reliability  coefficients  will  be  determined. 
This  procedure  will  serve  as  a check  on  our  Interviewers  and  on  the  reliability 
of  the  respondent's  answers. 

Interview  data  will  be  tabulated  initially  by  groups  of  users  and 
non-users  to  determine  what  kinds  of  DDC  produced/disseminated  information  each 
group  is  aware  of,  how  accf.sslble  it  is,  how  useful  it  is,  and  how  it  could  be 
Improved. 

Results  for  individual  groups  will  then  be  compared  to  look  for  simi- 
larities and  differences  in  their  responses  to  these  questions,  with  regard  to 
the  kinds  of  information  they  use,  and  how  useful  they  find  it,  etc.  Where 
apparent  differences  are  detected,  these  will  be  tested  for  significance  to 
determine  whether  such  differences  are  attributable  to  sampling  error,  or  are  a 
function  of  statistically  reliable  differences  between  groups.  All  analyses 
performed  and  the  results  will  be  documented  in  the  final  study  report. 

It  is  anticipated  that  the  statistical  analysis  of  survey  results 
will  allow  for  the  determination  of  the  accessibility,  quality,  quantity, 
response  time  and  degree  to  which  DDC  and  comparable  services  from  other 
agencies  are  up-to-date,  as  well  as  the  reasons  for  satisfaction  or  dissatis- 
faction by  them.  Reasons  for  Information  non-use  by  potential  users  will 
also  be  determined  along  with  an  assessment  of  current  feedback  mechanisms. 
Reasons  given  by  non-users  for  their  failure  to  utilize  DDC  facilities  will 
also  be  determined. 

The  major  purpose  of  the  survey,  however,  will  be  to  draw  inferences 
from  the  above  data  and  extrapolate  in  order  to  predict  the  total  demand  of 
the  user  population  on  DDC's  capability  during  the  1978-1988  period. 


As  a function  of  the  use’,  survey,  the  adequacy  of  current  feedback 
mechanisms  to  various  user  categories  will  be  determined.  Based  on  this  evalua- 
tion, alternative  user  feedback  mechanisms  will  be  defined  and  reviewed  with 
selected  users  to  test  their  efficacy.  As  appropriate,  these  feedback  mechanisms 
may  actually  be  implemented  between  users  and  particular  DDC  programs  to 
judge  their  adequacy  further  in  a real-world  environment. 

Those  feedback  mechanisms  showing  greatest  promise  will  be  defined 
and  reported  upon  in  the  final  report.  The  discussion  will  address  how  the 
feedback  mechanism(s)  will  Interface  with  current  and  projected  DDC  information 
production  and  dissemination  functions. 

(3)  Agency  statistician  who  reviewed  and  approved  the  statistical  aspects 

of  this  design  is  . 

(4)  Contractor:  AUERBACH  Associates,  Inc. 

121  North  Broad  Street 
Philadelphia,  PA  19107 


Role;  Design  and  pre-test  survey  questionnaire,  conduct 

user  interviews,  tabulate  and  analyze  data  and  in- 
terpret results  in  terms  of  study  purpose  and  ob- 
jectives . 

Data:  Completed  interview  forms  will  be  used  only  to  tabu- 

late survey  results.  Individual  interviews  will  not 
be  cited  in  study  reports,  or  otherwise  disclosed. 
DDC  will  instruct  AUERBACH  regarding  disposition  of 
completed  interview  forms  at  contract  termination. 


3.  TABULATION  AND  PUBLICATION  PLANS 


(1)  There  are  no  plans  at  present  to  publish  the  data.  Results  of  the 

analysis  of  completed  Interviews  will  be  cited  In  project  reports  to  establish 
a basis  for  various  findings  and  recommendations  made  therein.  These  reports, 
or  excerpts  from  them,  may  eventually  be  published.  , 

(2)  Survey  results  will  be  analyzed  and  tabulated  by  AUERBACH 's  subcon- 
tractor, Criterion  Development  Associates,  Inc.  via  standard  statistical  analysis 
software  packages  available  at  the  Memphis  State  University  (MSU)  Computing 
Center,  where  all  computing  will  be  accorq)li6hed, 

AUERBACH  will  select  the  most  efficient  and  appropriate  program 
packages  from  SPSS,  the  Statistical  Package  for  the  Social  Sciences,  and  BMD, 
the  Biomedical  Computer  Programs. 

SPSS,  developed  at  the  University  of  Chicago,  is  a comprehensive, 
general-purpose  statistical  program  package,  designed  to  perform  a wide  range 
of  analyses.  It  computes  many  types  of  statistical  analyses  and  provides  a 
capability  which  offers  the  user  a vast  saving  in  time  and  effort.  SPSS  pro- 
vides several  attractive  features  for  data  base  maintenance,  such  as  extensive 
variable  labeling  capabilities,  selective  processing  of  data  items,  user 
specified  data  transformation,  and  data  file  generation  in  both  BCD  and  binary 
formats.  Its  statistical  procedures  Include  descriptive  statistics  and  one-way 
frequencies,  table  displays  of  relationships  between  two  or  more  variables, 
correlation  axialyses,  multivariate  analyses,  and  scalogram  analysis.  The  SPSS 
documentation  Is  exceptionally  complete. 


The  HMD's , a well-known  extensively  used  complement  of  more  than 
sixty  FORTRAN  programs,  was  developed  by  the  Health  Sciences  Computing  Facility 
of  the  University  of  Califonia  (Los  Angeles)  and  has  proven  useful  in  research 
projects  in  themedical  and  f ocial  sciences.  HMD  programs  on  the  MSU  system 
are  in  the  areas  of  description  and  tabulation,  multivariate  analysis,  regres- 
sion  analysis,  analysis  of  variance,  and  time  series  analysis.  A number  of 
special  programs  and  the  UMD-X  Series  of  programs  are  also  Included. 

This  software  will  be  used  in  the  following  statistical  analyses: 

(a)  Multiple  regression  analyses  and  analyses  of  variance. 

(b)  Analysis  of  variance  factional  design. 

(c)  Continuing  trend  analyses  of  interview  data'. 


! 


4.  TIME  SCHEDULE 


I 

(1)  The  contract  under  which  this  survey  is  being  performed  began  on 
June  19,  1975  and  will  terminate  on  February  17,  1976.  The  project  work  plan 
provides  for  beginning  the  user  interviews  in  September,  1975,  and  completing 
this  field  work  by  the  end  of  October,  1975.  A draft  report  presenting  results 
of  this  survey  is  scheduled  for  the  end  of  November  1975. 

(2)  Although  there  are  no  plans  to  publish  the  survey  data,  formally, 
it  is  planned  to  have  these  results  available  to  the  Government  within  one 
month  after  completion  of  the  user  interviews. 


6 . RESPONDENT  BURDEN 


(1)  The  estimated  average  number  of  man*>hours  per  Interview  Is  one  hour. 

! 

(2)  Respondent  will  not  be  required  to  gather  and  compile  data.  Informa- 
tion requested  of  the  Interviewee  will  be  readily  available  to  him  based  upon 
his  experiences  In  obtaining  and  using  scientific  and  technical  Information. 
Interview  form  will  be  completed  by  contractor’s  interviewer;  hence,  no 
respondent  clerical  time  will  be  required. 

(3)  Time  required  to  complete  an  Interview  will  depend  on  factors  such 

as:  extent  to  which  Interviewee  uses  DDC  Information;  facility  with  which  he 

responds  to  questions;  and,  his  Interest  in  discussing  Information  issues  and 
problems . 
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ESTIMATED  COSTS  OF  SURVEY 


$15,136  - Design  and  Pre-test 

31,842  - Interviewing 

1,420  - Travel  and  Living 

44,18C  - Analysis 

$91, 578  - TOTAL  ESTIMATED  SURVEY  COST 


Note; 


Above  cost  estinvites  include  overhead  and  other  loading  factors. 


APPENDICES 


Interivew  Schedule  To  Be  Used  For  Bench  Level  Scientists  & Managers 
Of  RDT&E  Activities 

Interview  Schedule  to  Be  Used  For  Technical  Support  Personnel 

1 

Pre-Mai led  Response  Cards  j 

Covering  Letter 
Justification  of  Survey  Plan 


APPENDIX  A 


Interview  Schedule  to  be  Used  for 
Bench  Level  Scientists  & Manag-^rs 
of  RDT&E  Activities 


FACE  SHEET 
DSA  900-75-C-5161 


A.  Information  not  to  be  keypunched 

I 

1 . Date  of  Interview 

2.  Time  interview  began 

3.  Time  Interview  ended 

4.  Interviewer's  name 

5.  Name  of  respondent 

6.  Respondent's  organization 

B.  Information  to  be  keypunched 

1.  MIL/GS  rating 

2.  What  is  your  Job  title? > 

3.  Sex 

4 . Year  of  birth 

5.  Highest  degree  (s) ■ 

Year  (s)  obtained 

7.  Academic/Professional  area  of  degree 

8.  Number  of  personnel  supervised 

9.  Years  of  experience  In  R&D 

10,  Check  one:  confidential secret ^top  secret 

11 . In  a few  words  please  tell  me  what  you  do  on  your  Job. 


12. 

Job  level  (CHECK  ONE) 

1 . Bench  level  ( ) 

2.  Support  ( ) 

3.  Management  ( ) 

13. 

Please  turn  ^o  Card  #12.  Pick  your  major  category  and  choose  one 

subfield. 

14. 

Organization's  User  Code  # 

15. 

Contractor  or 

^DOD  Organization 

16. 

Key  user  organization  or 

all  the  rest. 

17. 

18. 
19. 

State: 

Area  Code: 
Interviewer's  Code#: 

i 

) 


d 


INTERVIEW  SCHEDULE  DSA900-75-C-51 61 

FOR  BENCH  LEVEI  ^ND  MANAGEMENT  USERS  AND  NON  USERS 

DOD  INSTALLATI  ^S  AND  DOD  CONTRACTOR  PERSONNEL  (Pending  0MB  approval) 


(1)  I would  like  to  ask  you  about  any  research  In  which  you  have  been 
Involved  during  ♦he  past  six  months.  Can  you  ♦ell  me  about  the 
research  that  you've  worked  on  during  this  time? 

(IF  RESPONDENT  IS  HESITANT  BECAUSE  OF  SECURITY  SAY,  "We're  going  to  con- 
dvict  this  at  an  unclassified  level.")  . 


(la)  If  R describes  research 


(lb)  If  R.ls  not  Involved  In  any 
research 


(Determine  other  needs  for  Infor- 
mation) 

What  are  the  major  tasks  Involved 
In  your  Job? 


ASK  R TO  IDENTIFY  A MAJOR  AC- 
TIVITY THAT  HAS  REQUIRED  INFOR- 
MATION SEARCH 


(Many  of  the  questions  that  follow  are  highly  structured.  Please  answer  them 
In  terms  of  the  Cards  we've  sent.  As  the  Interview  progresses  I'll  be  asking 
questions  that  will  encourage  you  to  tell  me  all  about  how  you  search  for  Infor- 
mation.) 


(2)  On  the  average,  how  many  hours  per  week  do  you  spend  In  research  and  re- 
search related  activities? ^ 
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(3)  Please  turn  to  Card  #1 . Generally  speaking,  how  much  need  do  you  have 
for  scientific  and  technical  Information? 


(4)  Again  looking  at  Card  #1 , In  general,  how  much  need  do  you  have  for 
scientific  and  technical  Information  from  sources  outside  yo.ur  own 
office  or  laboratory? 


RE-INSERT  CARD  #1 


Later  on  you'll  stay  with  the  same  card  for  several  questions  In  a row  like  we 
Just  did.  To  avoid  boring  you  I won't  tell  you  to  keep  looking  at  the  same 
card  each  time;  so  if  you're  not  sure  at  any  point  just  tell  me. 

(5)  Now  I would  like  to  ask  you  about  the  Information  that  you  search  for  In 
connection  with  your  research  projects.  Do  you  conduct  your  own  Infor- 
mation searches,  or  do  you  have  someone  else  do  It  for  you? 

^Conduct  it  personally 

Have  someone  else  do  It 

Both;  (If  both)  (5a)  What  percentage  of  the  searching 

, do  you  conduct  personally? 

% 


(IF  R ANSWERS  "HAVE  SOMEONE  ELSE  DO  IT,  " DETERMINE  WHO  THIS  PERSON  IS,  AND  PROBE 
TO  DETERMINE  WHETHER  OR  NOT  R CAN  ANSWER  AS  IF  HE  DOES  THE  INFORMATION  SEARCH 
HIMSELF.) 

(6>  Where  do  you  generally  go  first  to  search  for  the  Information  that  you  need? 

Consultant  Supervisor 

^Friend,  Peer  of  Associate  Personal  Collection 

Departmental  Collection  Distant  library 

Mechanized  Information 
Service 

Other  (specify) 


In  house  library 
Semlnar/Meetlng/Conference 
Publisher,  Bookstore 


INTERVIEW  SCHEDULE  DSA900-75-C-51 61 

FOR  BENCH  LEVEL  AND  MANAGEMENT  USERS  AND  NON  USERS 

DOD  INSTALLATIONS  AND  DOD  CONTRACTOR  PERSONNEL  (Pending  0MB  approval) 


(1)  I would  like  to  ask  you  about  any  research  in  which  you  have  been 
Involved  during  the  past  six  months.  Can  you  tell  me  about  the 
research  that  you've  worked  on  during  this  time? 


(IF  RESPONDENT  IS  HESITANT  BECAUSE  OF  SECURITY  SAY,  "We're  going  to  con- 
duct  this  at  an  unclassified  level.")  . 


(la)  If  R describes  research 

(lb)  If  R is  not  involved  in  any 
research 

(Determine  other  needs  for  infor- 
mation) 

What  are  the  major  tasks  Involved 
in  your  job? 

ASK  R TO  IDENTIFY  THE  MAJOR 
RESEARCH  PROJECTS  OR  PROJECT 
AREAS  THAT  HE  H/\S  WORKED  ON 
SOMETIME  DURING  THE  PAST 
6 MONTHS 

ASK  R TO  IDENTIFY  A MAJOR  AC- 
TIVITY THAT  HAS  REQUIRED  INFOR 
MATION  SEARCH 

(Many  of  the  questions  that  follow  are  highly  structured.  Please  answer  them 
in  terms  of  the  Cards  we've  sent.  As  the  Interview  progresses  I'll  be  asking 
questions  that  will  encourage  you  to  tell  me  all  about  how  you  search  for  infor- 
mation.) 

(2)  On  the  average,  how  many  hours  per  week  do  you  spend  in  research  and  re- 
search related  activities? 


rr 
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(7)  Is  ( ) generally  the  most  useful  single 

INSERT  FIRST  PLACE  R GOES  Q#6 
source  for  helping  you  locate  the  Information  that  you  need? 


GO  TO  Q#8  (7b)  What  Is  generally  the  most  useful  single  source? 


Personal  Collection 

Distant  Library 

Friend.  Peer  or  Associate 

Mechanized  Information 
Service 

^Departmental  Collection 

^Consultant 

in  House  Library 

Semlnars/Conferences/Meetlngs  . 

Other  (specify) 

Supervisor 

! 

Publlsher/Book  store 

1 

(7c)  Why  Is  (_ ) 

• INSERT  FIRST  PLACE  R GOES  Q#6 
Inadequate  for  your  needs  ? 


(8)  Please  turn  to  Card  #2.  Why  do  you  go  to  ( )? 

INSERT  #1  SOURCE 


(9)  Please  turn  to  Card  #3.  When  you  go  to  ( ) 

INSERT  MOST  IMPORTANT  SOURCE 

what  format  Is  the  Information  In  that  you  generally  find  most  useful? 

(PLACE  A 1 NEXT  TO  THE  APPROPRIATE  CATEGORY  ON  CARD  #3  BELOW) 


1 
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CARD  #3  FORMATS 

^Computer  Generated  Bibliographies 

^Technical  Reports 

Personal  Conversation 

Abstract  Journals 

^Published  Bibliographies  (Lists) 

Books 

^Handbooks,  Manuals 

Management  Reports;  i.e.,  manpower,  funding,  project  status, 

, . resource  allocation  and  status 

Journals 

• % 

^Reviews/  State  of  the  Art  papers 

Current  Awareness  or  Automatic  Announcement  Services 
Numeric  Data  Compilations 
^Commercial  Brochures 

Other 

(10)  Why  do  you  find  ( ) so  useful? 

SOURCE#!  FORMAT#! 


(11)  Are  there  any  disadvantages? 
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(WHEREVER  QUESTIONS  ARE  NOT  ANSWERED  INDICATE  SAME  WITH  A STRAIGHT  45**  LINE  FROM 
RIGHT  TO  LEFT  DRAWN  THROUGH  THE  UNANSWERED  QUESTIONS  ) 

(12)  What  porcentcige  of  the  information  you  neerl  typically  comes  from 

( ) in  the  form  of  ( ) ? 

SOURCE  #1  FORMAT  #1  % 


(13)  Do  you  find  any  other  useful  information  that  Is  in  a different  format? 

Yes  No 

GO  TO  Q#18 

(PLACE  A 2 NEXT  TO  THE  APPROPRIATE  CATEGORY  ON  CARD  #3) 

(14)  Why  do  you  find  ( ) so  useful? 

FORMAT  #2 


(15)  Are  there  any  disadvantages? 


(16)  What  percentage  of  the  Information  you  need  typically  comes  from 

( ) in  the  form  of  ( )? 

SOURCE#!)  FORIvlAT#2  % 


(17)  Please  turn  again  to  Card  #3.  What  other  useful  formats  of  information 
do  you  rely  on? 
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(1^  Generally  speaking  what  is  the  second  most  useful  source  for  helping 
you  locate  the  information  you  need? 


Consultant 


Friend,  Poor,  Associate 
Departmental  Collection 
_In  house  library 
Publisher,  Bookstore 


Supervisor 


(IF  NO  SECOND  SOURCE) 

i 

GO  TO  0 #31 


_Semlnui  s/Meetlngs/ 
Conferences 

_Dlstant  Library 

_Personal  Collection 

_Mechanlzed  Information 
Service 

Other  (specify) 


(19)  Please  refer  to  Card  #2.  Why  did  you  go  to  (_ 


) next? 


INSERT  #2  SOURCE 


(20)  Pledie  refer  to  Card  #3.  When  you  went  to  ( ) 

INSERT  SOURCE  #2  Q#18 

what  format  was  the  Information  In  that  you  found  most  useful? 


(21)  Why  did  you  find  it  useful? 


(22)  Are  there  any  disadvantages? 
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(23)  What  percentage  of  the  Information  you  need  typically  comes  from 

( )? 

INSERT  FORMAT  #1  FROM  SOURCE  #2  % 


(24)  Refer  again  to  Card  #3.  Did  you  find  any  other  useful  Information  that 

is  In  a different  format? 

(25)  Why  did  you  find  It  useful? 


(26)  Are  there  any  disadvantages?^ 


(27)  What  percentage  of  the  Information  you  need  typically  comes  from 

( ^ )? 

INSERT  FORMAT  #2  FROM  SOURCE  #2  % 


(28a)  Are  there  any  other  sources  where  you  find  Information  that  Is  Important 
for  your  purposes? 




X 

D TO  ( 


GO  TO  Q#31 


Ye 


(28b)  What  are  they? 


Friend*  Peer,  Associate 


Consultant 


_In  House  Library 

_Departmental  Collection 

_Publlsher/Book  store 
^Supervisor 


Semlnar/Meetlng/Conference 


Personal  Collection 


^Distant  Library 

_Mechanlzed  Information  Service 
_Other  (specify) 
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(29)  Refer  to  Card  #3.  When  you  went  there  what  format  was  the  information 
In  that  you  found  to  be  most  useful? 


(30a)  Did  you  find  any  other  useful  information  that  was  in  a different  format? 

Yes  No  (GO  TO  0 #31) 


(30b)  Specify 


(IF  £ HAS  MENTIONED  FORMAL  SOURCES)  I want  to  ask  you  about  informaf' 
3OU»C0:v.  of  ir.;  <;'!nat.ion.  (GO  TO  Q #31)  (IF  R HAS  NOT  MENTIONED  ANY 
INFORMAI.  .‘SOURCES  YET,  SAY:)  You've  mentioned  formal  sources  such  as 

( ) and  ( ).  Now  I want  to  ask  you  about  informal 

INSERT'sOURCE  #1  #2  SOURCE 

sources  of  information. 

(31)  Do  you  knov/  what  I mean  by  informal  sources  of  information? 

Yes  No 


(ELICIT  AN  EXAMPLE  FROM  R) 
(32a)  Do  you  rely  on  any  informal  sources? 


Yes 

^No 

(32b)  How  are  they  useful? 

(32d)  Whv  not? 

(32c)  What  do  they  provide  that  for- 

mal  sources  don't? 

» • 

R HAS  NOT  MENTIONED  A PERSONAL  COLLECTION  OR  FILE  YET  ASK  Q#33a.  IF  HE  HAS  GO  TO 

#34) 
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(33a)  Do  you  maintain  a personal  collection  or  file? 

(33b)  Ybb  (33c)  Ho 

Why  not? 

GO  TO  0#34  


GO  TO  Q#37 

(34)  You've  told  me  about  your  personal  collection.  Why  do  you  maintain  a 
personal  collection? 


(35)  How  is  it  organised? 


(36a)  Does  it  include  microfiche? 

Yes  ^Mo 

(36b)  Could  you  use  assistance  in  organizing  your  collection? 

Yes  ^No 


(36c)  What  kind  of  assistance? 

(36d)  Whv  not? 

(P  B HAS  MEKTIOHED  USING  A MECHANIZED  INFORMATION  SERVICE,  ASK  Q #37  THRU  #46.  IF  I 
«OT,  ASK  IF  HE  HAS  EVER  USED  ONE.  IP  SO,  IDENTIFY  THE  SERVICE  AND  ASK  QUESTIONS  37-461 
T NOT,  PROCEED  WITH  QUESTION  #47.)  | 


Name  of  service  not  previously  identified: 
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(37)  Now  I'd  like  to  ask  you  about  ( 

).  INSERT  MECHANIZED  INFORMATION 

SERVICE  MENTIONED  ABOVE 

Who  Initiated  the  search,  yourself  or  someone  else? 

Yourself  ^Someone  else 

(38)  Please  turn  to  Card  #4.  How  was  the  search  Initiated? 


(39)  What  percentage  of  the  titles  delivered  were  of  real  use  to  you? % 

(40)  penerally  speaking  do  you  screen  the  titles  or  does  someone  else? 

You  Someone  else 

(41)  Generally  speaking,  how  long  does  it  take? 

^Hours-  ^Minutes 

(42)  Is  It  generally  necessary  to  go  to  other  sources  to  complete  your  search? 

Yes  ^No 


(43)  Why  Is  It  necessary? 
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(44)  Please  refer  to  Card  #5.  In  your  opinion,  how  satisfactory  has  the 
performance  of  the  mechanized  Information  service  (s)  been? 

INSERT  CARD  #5 

Expla  In: 


(45)  How  much  time  is  typically  involved  from  the  initiation  of  the  request 
until  the  information  is  received? 

Days  Hours 

t 

(46a)  Did  the  information  arrive  in  time  to  b.e  of  use  to  you? 

Yes  ^No 

(46b)  How  much  faster  would 
It  have  to  arrive? 


(46c)  Do  you  know  why  it  took 
so  long? ^ 


(47)  Please  refer  to  Card  #6.  During  the  past  six  months  have  you  had  any 
problems  locating  information? 


(48)  For  research  projects  like  the  ones  we’ve  been  talking  about,  what 
would  be  the  most  ideal  way  to  locate  the  information  you  need? 
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(49)  Please  turn  to  Card  #7.  Please  rank  the  media  you  have  relied  on  most 
during  the  past  year? 

Medium  % 

1 St  


2nd 


3rd 


4th 


(DO  NOT  BE  CONCERNED  IF  R CANNOT  IDENTIFY  A 3rd  OR  4th  CHOICE) 

(50)  Now,  what  percentage  of  the  information  you  needed  came  to  you  as 

( ),  ( ),  etc.  1st % 

INSERT  FIRST  CHOICE  SECOND  CHOICE  2nd % 

3rd % 

4th % 

(51)  Please  turn  to  Card  #5  for  the  next  series  of  questions.  Now  please 
think  about  all  of  the  information  you  needed  and  searched  for  during 
the  past  year.  To  what  extent  did  the  amount  of  information  you 
received  meet  your  needs? 

RE-INSERT  CARD  #5  ___ 

(52)  To  what  extent  did  the  quality  of  Information  you  received  meet  your  needs? 

RE-INSERT  CARD  #5  


(53)  To  what  extent  did  the  time  between  yo  r Initial  request  and  the  delivery 
of  the  information  meet  your  needs? 

RE-INSERT  CARD  #5.  ♦ • 


(54)  Now  please  turn  to  Card  #8.  To  what  extent  was  the  Information  re- 
ceived up-to-date? 

RE-INSERT  CARD  #8  


(55)  Now  please  go  back  to  Card  #5.  To  what  extent  did  the  media  In  which 
you  received  the  Information  meet  your  needs? 


RE-INSERT  CARD  #5 
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(56)  To  what  extent  did  the  formats  meet  your  needs? 

RE-INSERT  CARD  #5 


(57)  How  much  did  the  information  services  you  received  from  ( ) 

cost  you  (or  your  organization)  ? #1  & #2  SOURCES 


(57a)  (_ 


) 


1st  SOURCE 


(57b)  (. 


.) 


2nd  SOURCE 


(58a)  Would  you  be  willing  to  pay  more  to  improve  the  ( 

_)of  the  Information?  INSERT  LOWEST 

RATED  ASPECT  Q#51-56 

Yes 

(S8b)  How  much  more? 

In  absolute  terms:. 

Percentagewise: 


(59a)  (If  appropriate)  Would  you  be  willing  to  wait  longer  to  Improve  the 
( ) of  the  information? 


INSERT  LOWEST  RATED  ASPECT  Q#51-56 

fes 


-No 


(59b)  How  much  longer? 

1 

(59c)  Why  not? 

In  absolute  terms: 

1 

Percentagewise: 

1 

■ 

. 

(60)  Now  I would  like  you  to  project  yourself  backward  in  time  to  1970.  I 
would  like  to  get  an  idea  of  how  the  information  you  obtained  then  and 
the  way  that  you  went  about  finding  it  compares  to  the  information  you 
obtained  this  year  and  the  way  you  found  it.  First,  were  you  engaged 
In  information  search  five  years  ago? 


Yes 


No  (GOTOQ#70) 


Page  14 


(61)  As  much  as  possible  I would  like  you  to  think  about  the  major  research 
projects  you  were  working  on  during  1970.  Can  you  tell  me  what  they 
were?  (USE  WHATEVER  MEMORY  JOGGERS  MAY  BE  NECESSARY. ) 


(62)  Please  turn  to  Card  #5.  In  terms  of  your  needs  back  In  1970, to  what 
extent  did  the  amount  of  Information  you  received  meet  your  needs? 

RE-INSERT  CARD  #5  

! 

(63)  In  terms  or  your  needs  back  In  1970.  to  what  extent  did  the  quality  of 
information  you  received  meet  your  needs? 

I 

RE-INSERT  CARD  #5  

(64)  In  terms  of  your  needs  back  in  1970.  to  what  extent  did  the  time  between 
your  initial  request  and  delivery  of  the  information  meet  your  needs? 

RE-INSERT  CARD  #5 

(65)  Now,  please  turn  to  Card  #8.  In  terms  of  your  needs  back  In  1970,  to  what 
extent  was  the  information  that  you  obtained  up-to-date? 

RE-INSERT  CARD  #8 

(66)  Turn  to  Card  #7.  What  was  the  predominant  medium  that  the  Information 
you  received  in? 

RE-INSERT  CARD  #7  . 

(67)  Turn  to  Card  #3.  What  was  the  predominant  format  that  the  information 
you  received  in? 

RE-INSERT  CARD  #3  

(68)  Turn  to  Card  #5.  To  what  extent  did  the  medium  meet  your  needs? 


RE-INSERT  CARD  #5 
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(69)  To  what  extent  did  the  format  meet  your  needs? 

RE-INSERT  CARD  #5 


(READ  THE  FOLLOWING  SLOWLY  TO  R) 

(70)  We've  covered  a lot  of  questions  so  far.  You  have  given  me  a lot  of 
very  useful  Information.  Now,  I'd  like  to  shift  gears  for  a moment. 

Are  you  comfortable?  Okay,  take  a breather,  flex  your  muscles  and 
sit  back  In  your  chair.  I'm  going  to  ask  you  to  stretch  your  mind  a 
bit,  think  about  the  future  and  Imagine  what  It  might  be  like,  Do 
you  remember  the  book  Future  Shock  ? Do  you  remember  the  major 
points  the  author  was  making?  (INTERVIEWER  EXPLAINS  AS  NECESSARY) 


Now  please  try  to  anticipate  your  needs  for  Information  as  they  will 
be  five  years  from  now.  In  doing  so,  please  try  to  compare  what 
you  have  experienced  this  year  In  receiving  Information  from  your 
most  useful  source  to  what  you  think  your  needs  will  be  In  1980. 

Do  you  think  that  you  understand  what  I want  you  to  do? 

^Yes  No 

, INTERVIEWER  MUST  EXPLAIN  PROCESS  IN  MORE  DETAIL 

(71)  Okay,  I'd  like  you  to  project  yourself  Into  the  future  to  1980.  How  do 
you  think  your  field  will  have  changed  by  then? 


(72)  What  do  you  think  you  will  be  doing  then? 


(73)  How  do  you  think  these  changes  you've  mentioned  will  affect  your 
need  for  Information? 
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(DETERMINE  IF  R FEELS  COMFORTABLE  WITH  THIS  LINE  OF  QUESTIONIN 
(IF  "NO",  INTERVIEWER  MUST  EXPLAIN  PROCESS  IN  MORE  DETAIL) 

(74)  Please  turn  to  Card  #9.  Would  the  amount  of  Information  you  have  re- 
ceived this  year  meet  your  needs  in  1980? 

RE-INSERT  CARD  #9  

(75)  Would  the  quality  of  information  you  recieved  this  year  meet  your  needs 
In  1980? 


RE-INSERT  CARD  #9  

(76)  Would  the  time  between  your  initial  request  and  delivery  of  the  informa- 
tion this  year  meet  your  heeds  in  1980? 

RE-INSERT  CARD  #9  

(77)  'Would  the  extent  to  which  the  information  you  received  this  year  was 
up-to-date  meet  your  needs  in  1980? 

RE-INSERT  CARD  #9  

(78)  Would  the  predominant  format  of  the  Information  you  received  this  year 
meet  your  needs  in  1980? 

RE-INSERT  CARD  #9  

(79)  Would  the  predominant  medium  of  the  information  you  received  this  year 
meet  your  needs  in  1980? 


RE-INSERT  CARD  #9 
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(80)  Would  you  like  to  see  any  changes  In  the  amount  of  information  you 
receive  by  1980? 


Ye^  (Be  specific) ^No 


i 


} 

t 


(81) 


Would  you  like  to  see  any  changes  in  the  quality  of  Information  you 
receive  by  1980? 


I 

f*  Yes  (be  specific)  ^No 


i 


i 

i 

i 

i 

1 

j 


(82)  Would  you  like  to  see  any  changes  in  the  time  between  request  and 
delivery  by  1980? 

Yes  (be  specific)  ^No 


(83)  By  1980,  would  you  like  to  see  any  changes  in  the  degree  to  which  the 
Information  you  receive  is  up-to-date? 

Yes  (be  specific)  ^No 
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(84)  Would  you  like  to  see  any  changes  In  the  medium  In  which  you  receive 
information  by  1980? 

Yes  (be  specific)  ^No 


(85)  Would  you  Viike  to  see  any  changes  In  the  format  of  the  information  you 
receive  by  1980? 

Yes  (be  specific)  No  ^ 

• % ■ “ “ - - . - ______ 


(86)  Which  of  the  changes  you'd  like  to  see  would  be  most  useful  to  you? 
(Expla  In) 


(87a)  Would  you  be  willing  to  pay  more  for  this  change? 


(87b)  ^Yes  (87c) No 


How  much  more? 

Why  Not? 

^ . ... 



(If  Appropriate)  Would  you  be  willing  to  wait  longer  from  initial 
request  to  time  of  delivery  for  this  change? 

(88b)  Yes 

(88c)  No 

- 

How  much  longer? 

V/hy  not? 
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(89)  Now  please  turn  to  Card  #10.  In  the  future  what  do  you  think  will 
happen  to  your  need  for  services  you  subscribe  to  versus  those  that 
you  receive  oni  request  (or  demand)? 

(90a)  There  are  a number  of  services  which  automatically  provide  Information 
according  to  previously  registered  categories.  Do  you  subscribe  to  any 
such  services  now? 


(90b)  What  are  they? 


(90d)  Do  you  pay  for  them? 


(90c)  Why  not?. 


GO  TO  #91 


(91)  Please  turn  to  Card  11.  If  a service  was  available  that  could  match 
your  Information  needs  and  specialty  area  very  closely,  how  valuable 
would  it  be  to  you  in  your  work? 


(92a)  Would  you  be  willing  to  pay  for  it? 
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(93a)  Which  would  you  prefer?  A free  service  covering  broad  areas,  or  a 
service  you  pay  for  covering  your  precise  needs  and  specialty? 


Service  you  pay  for 


(93b)  How  much  would  It  be  worth 
to  you? 


Free  service 


(94)  Do  you  know  what  the  letters  DDC  stand  for? 


(95)  Have  you  ever  seen  a report,  summary  or  bibliography  produced  by  DDC? 


(96)  If  yes,  have  you  had  occasion  to  request  any  Information  from  DDC? 


THE  BALANCE  OF  THIS  INTERVIEW  18  FOR  ESTABLISHED  USERS  OF  DDC  ONL' 


J 
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PART  II 

For  DDC  Users  Only 

(97)  Have  you  used  this  Information  In  any  work  that  you  have  undertaken 
In  the  last  6 months? 

« •** 

Yes  No 


(98)  How  much  time  did  It  take  for  you  to  prepare  a request  for  DDC? 

^H  D W M 

(99)  When  you  initiate  a search  for  Information  from  DDC  how  do  you 
usually  do  It? 

^Telephone  Mall  ^Thru  Intermediary  ^Other 

I 

(100)  When  you  Initiate  a search  for  Information  from  other  sources,  how 
*do  you  usually  do  It? 

I 

Telephone  Mall  ^Thru  Intermediary  Other 

(101)  Approximately  how  many  references  are  usually  delivered? 

(101a)  From  DDC (101b)  From  other  sources  

(102)  How  many  of  these  references  (approximately)  are  useful  to  you? 

From  DDC 

(103)  From  other 

(104)  On  Card  #12  you  will  find  a list  of  subject  areas  within  the  DDC  col- 
lection. Could  you  take  a few  minutes,  look  this  over,  and  tell  me 
which  areas  are  most  useful  to  you  in  your  own  research? 
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(105)  On  Card  #13,  you  will  find  a listing  of  the  request  services  provided 
by  DDC,  Please  scan  the  list  and  tell  me  which  ones  you  are  aware 
of.  (INTERVIEWER  WILL  LIST) 


^Technical  Report  Program  _ 

R&D  Program  Planning  Information  _ 

System 

^R&T  Work  Unit  Info.  System  _ 

Independent  Research  & Develop- 
ment Data  Bank  (IR&D)  _ 

^Scheduled  Bibliographies 

RDT&E  On-Line  Retrieval  System  _ 

^Report  Bibliographies  on  Magnetic  _ 

Tape  (RBMT) 

(106)  Now  will  you  please  rank  these  request  systems  In  terms  of  those  that 
you  find  to  bo  most  useful? 


_Current  Awareness 
Defense  R&D  of  the  '60's 
and  1970 

_Defense  Retrieval  Indexing 
Terminology  (DRIT) 

^Defense  Retrieval  Indexing 
Terminology  Hierarchy  (DRIT-H) 
_DDC  Referral  Services 
_Report  Bibliographies 


(1) 

(2) 

(3) 


(107)  Will  you  rank  those  that  you  find  least  useful? 
are  aware  of  (RANK  LEAST  USEFUL  1st,  etc.) 

(1) 


Include  only  those  you 


(2) 

(3) 


(108)  On  Card  #14  you  will  find  a list  of  the  subscription  services  provided  by 
DDC.  Please  scan  the  list  and  tell  me  which  ones  you're  aware  of. 

(1)  Automatic  Distribution  of  Documents  (ADD) 

_(2)  Selective  Dissemination  of  Information  Software  Packages 

(3)  Technical  Abstract  Bulletin  (TAB)  & Indexes 

(4)  Automatic  Magnetic  Tape  Distribution  (TAB  on  Tape) 

(5)  DDC  Digest 

(6)  Recurring  Reports  (WUIS) 

(7)  Recurring  Reports  (Program  Planning) 

(8)  Current  Awareness  Bibliographies 

(9)  Recurring  Reports  (IR&D)  (DOD  USERS  ONLY) 
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(109)  Now  will  you  please  rank  these  subscription  services  In  terms  of  those 
that  you  find  most  useful? 

(1) 

(2) 

(3) 

(110)  Out  of  those  subscription  services  that  you  are  famdlar  with,  please 
rank  those  that  are  least  useful  to  you. 

(1)  ^ (Least  useful) 

(2)  (next  to  least  useful) 

(3)  • i 

(111)  Now,  remember  those  questions  I asked  about  the  future,  I want  you 

' to  relax  again  and  stretch  your  mind.  What  services  do  you  think  DDC 
should  provide  In  the  future  that  are  not  being  provided  now?  First, 
tell  me  about  the  near  future,  then  about  the  distant  future. 

(NEAR  FUTURE  EQUALS  "WITHIN  THE  YEAR") 

NEAR  FUTURE  DISTANT  FUTURE 


/ 
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(112)  Please  turn  to  Card  #15,  How  were  you  first  made  aware  of 

( )? 

INSERT  REQUEST  SERVICE  RANKED  #1  In  Q #106 

(113)  How  were  you  first  made  aware  of  ( 

INSERT  SUBSCRIPTION  SERVICE 

)? 

RANKED  #1  In  Q #109 

(114)  Could  you  suggest  any  better  ways  to  make  people  aware  of  these 
services  ? 


' % 

(115)  Would  training,  such  as  seminars,  cassette  tapes  or  programmed 
texts  on  DDC  services  be  of  help  to  you? 

Yes  ^No 


(116)  What  would  help  most  then? 


(117)  Would  you  make  use  of  ( ___)  if  (It)  (they)  (vad 

(were)  available?  INSERT  ANSWER  TO  #116 

^Ves.  ^No 


(H8)  At  the  present  time  what  do  you  think  is  the  most  efficient  way  of 
getting  information  from  DDC? 


(119)  Wliich  one  of  all  the  DDC  services  do  you  find  most  useful? 
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(120)  Now  I'd  like  to  ask  you  some  questions  about  ( 

INSERT  ANSWER  TO  Q #1 1 9 

(121)  Now,  turning  to  Card  #5,  what  about  the  quality  of  Information  from  DDC? 

RE-INSERT  CARD  #5  

(122)  What  about  the  quantity  c£  Information  from  DDC? 

RE-INSERT  CARD  #5  

(123)  What  about  the  time  between  request  and  delivery? 

Re-INSERT  CARD  #5  


(124)  What  about  the  degree  to  which  the  Information  was  up-to-date? 

RE-INSERT  CARD  #5 


(125)  Please  turn  to  Card  #3.  What  format  does  most  of  the  Information  come  In 

vrhen  you  receive  ( )? 

INSERT  MOST  USEFUL  SERVICE  Q #119 

RE-INSERT  CARD  #3  


(126)  Turn  back  to  Card  #5.  To  what  degree  does  this  format  meet  your  needs? 

RE-INSERT  CARD  #5  

(127)  Please  turn  to  Card  #7.  What  medium  does  most  of  the  Information  come 

In  when  you  receive  ( ) ? 

INSERT  MOST  USEFUL  SERVICE  Q #119 

RE-INSERT  CARD  #7 

(128)  Please  turn  back  to  Card  #5.  To  what  degree  does  this  medium  meet  your 
needs? 


RE-INSERT  CARD  #5 

T THIS  POINT  THE  INTERVIEWER  MUST  HELP  R SELECT  ANOTHER  INFORMATION  SOURCE  THAT  IS 
OMPARABLE  TO  DDC  IN  SERVICES  USED  BY  R.~  R MAY  HAVE  IDENTIFIED  SUCH  A SOURCE  IN 
\RT  I.  IF  SO,  FINE.  MERELY  PROCEED.  IF  NOT  ASK  R IF  HE  GOES  ELSEWHERE  FOR  SERVICES 
(MILAR  TO  THE  DDC  SERVICES  HE’S  JUST  DESCRIBED.) 
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(THEN.  INTERVIEWER  GOES  BACK  AND  REPEATS  ALL  QUESTIONS  121  THRU  128  FOR  THE  COMPARABLE 
SOURCE  THAT  THE  RESPONDENT  RELIED  ON  OTHER  THAN  DDC,  SUCH  AS  NTIS,  NASA,  etc. 
CONTINUE  TO  USE  SAME  CARDS.) 

(129)  

(130)  

(131)  

(132)  

(133)  

(135)  

(136)  


(137a)  Do  you  use  the  Research  and  Technology  Work  Unit  Information 

System  (WUIS)  ? (BASED  ON  DD  #1498) 


Yes 


No 


(137b)  >Vhy  not? 


(GOTO  #146a) 


(138)  How  often  do  you  use  WUIS?  

(139)  What  do  you  use  WUIS  for? 

(140)  Turn  to  Card  #5  again.  I want  to  ask  you  about  WUIS  now.  To  what 
extent  did  the  amount  of  the  Information  meet  your  needs? 

RE-INSERT  CARD  #5  


(141) 


To  what  extent  did  the  quality  of  the  Information  you  received  meet 
your  needs  ? 

RE-INSERT  CARD  #5  


(142)  To  what  extent  did  the  time  between  your  Initial  request  and  delivery 
meet  ,our  needs?  *5 
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(143)  Please  turn  to  Card  #8. 

To  what  extent  has  the  Information  you  received  been  up-to-date? 

Re-INSERT  CARD  #8  


(144) 


As  far  as  you  can  tell  what  percentage  of  the  work  units  you  would  be 
interested  In  was  covered  by  what  you  received? 

% 


(145a)  List  advantages  of  WUIS  (145b)  List  disadvantages 


(146a)  Do  you  use  Program  Planning  Reports?  (ASK  ONLY  DOD  PERSONNEL) 


Yes  ^No 


>1/ 

(146b)  Why  not? 

yf 

(GO  TO  #1 55a) 

(147)  How  often  do  you  use  Program  Planning  Reports? 

(148)  What  do  you  use  Program  Planning  Reports  for? 

(149)  Please  return  to  Card  #5.  I want  to  ask  you  about  Program  Planning  Reports  now 
To  what  extent  did  the  amount  of  information  meet  your  needs  ? 

RE-INSERT  CARD  #5  

(15(|  To  what  extent  did  the  quality  of  the  information  you  received  meet 
your  needs  ? 


RE-INSERT  CARD  #5  

(151)  To  what  extent  did  the  time  between  your  initial  request  and  delivery 
meet  your  needs? 


RE-INSERT  CARD  #5 
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(152)  Please  turn  to  Card  #8.  To  what  extent  has  tho  information  been  up-to-date? 

RE-INSERT  CARD  #8  

(153)  As  far  as  you  can  tell  what  percentage  of  the  information  you  would  be  in- 
terested in  was  covered  by  what  you  received? 


(154a)  List  advantages  of  Program  (154b)  List  disadvantages 

Planning  Reports 


(155a)  Do  you  use  the  Independent  Research  and  Development  Data  Bank  (IR&D)? 
(ASK  ONLY  DOD  PERSONNEL) 

Yes  ^No 

I 

(156)  How  often  do  you  use  IR&D? 

(157)  What  do  you  use  IR&D  for?__ 

(158)  Please  turn  to  Card  #5,  I want  to  ask  you  about  IR&D.  To  what  extent  did 
the  amount  of  information  meet  your  needs? 

RE-INSERT  CARD  #5  

(159)  To  what  extent  did  the  quality  of  the  information  meet  your  needs? 

RE-INSERT  CARD  #5  


(160)  To  what  extent  did  the  time  between  your  initial  request  and  delivery  meet 
your  needs  ? 
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(161)  Please  turn  to  Card  #8.  To  what  extent  has  the  Information  been  up-to-date? 

RE-INSERT  CARD  #8  

(162)  As  far  as  you  can  tell  what  percentage  of  the  Information  you  would  be 
Interested  In  was  covered  by  what  you  received? 

^ MAY  ELABORATE)  % 

(163a)  List  advantages  of  IR&O  (163b)  List  disadvantages 


(164)  Please  turn  to  Card  #16.  Here's  a list  of  Information  Analysis  Centers. 

Have  you  ever  used  the  services  of  c»i  lAvC. 

_Yes  No 

(165a)  Do  you  use  the  services  of  any  of  these  Information  Analysis  Centers  (lAC's) 

INSERT  CARD  #1 6 

Yes  — ^ ^No  — ^ 


(165b)  Which  one  (s)  ? 
(LIST  NUMBERS) 

(165c)  Why  not? 

, (a)  Never  heard  of  them 
(b)  Too  expensive 



. 

(c)  No  need 

(d)  .Not  In  area  of  Interest 

(e)  Other 

..  1 

(166)  How  do  you  use  these  services? 


rr"-  ...  — - - 
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I 

(167)  Are  more  lAC's  needed? 

yes  ^No 

(168)  What  modifications,  if  any,  are  needed  in  the  service  lAC's  provide? 


(169)  Do  you  ever  see  references  to  your  own  work  in  lAC  reports? 


(170)  Can  you  see  the  lAC's  as  useful  sources  of  information  for  you  in  the 
future? 

Yes  No  Please  explain 


(171a)  What  services  is  DDC  now  providing  that  should  be  changed  or  modified? 

(171b)  Services:  (171c)  Changes  or  Modifications: 


(172)  Do  you  have  access  to  a microfiche  reader? 

Yes  ^No 


(GO  TO  O #1 77) 


(173)  Please  turn  to  Card  #17.  How  available  is  this  reader? 


(174)  How  often  do  you  use  this  reader? 
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(17o)  How  often  did  you  use  It  5 years  ago? 


(176)  How  often  do  you  anticipate  using  It  in  the  future,  by  1980? 


(177)  Do  you  prefer  to  receive  information  on  microfiche  or  in  printed  copy? 

Microfiche  ^Printed  Copy 

(178)  If  you  could  substantially  reduce  the  time  lag  between  your  initial 
request  and  delivery  by  receiving  output  as  microfiche  Instead  of 
paper  would  you  be  interested? 

Yes  No  (GO  TO  Q #180) 

(179)  (If  appropriate)  How  many  days  earlier  would  you  have  to  receive  th.e 
information  in  order  for  you  to  accept  it  on  microfiche? 

Days 

(180)  Please  turn  again  to  Card  #12.  In  what  content  areas  do  you  Input 
information  to  DDC? 


(181)  In  the  output  you  get  from  DDC  do  you  see  references  to  your  own  work 
where  you  expect  them  to  be? 

Yes  ^No 


(182)  Have  you  ever  failed  to  get  needed  information  from  DDC? 
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(185)  Are  you  aware  of  Information  services  that  can  bring  output  directly 
to  the  user  where  he  Is  almost  immediately? 


i ^ (Explain)  GO  TO  #1  88a 

(186)  What  kind  of  services  are  you  aware  of?  ^ 


(187)  Have  you  overused  this  (these)  service  (s)  ? 


(188a)  (If  appropriate)  Are  you  familiar  with  the  DDC  Defense  RDT&E  On-Line 
System? 

Yes  No  (GO  TOO  #190) 


(190)  If  such  a service  could  be  precisely  keyed  to  your  Interests  and  be  com- 
plete what  would  you  be  willing  to  pay  for  It  (or  your  organization)? 


(191)  Do  you  know  that  services  like  these  can  be  connected  to  other  data 
bases  or  libraries  switching  automatically  as  needed? 


I 

1 
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I# 


(192)  Have  you  ever  used  such  an  Information  system? 

Yes  No 

(193)  Which  one? 


(194a)  For  your  purposes  does  this  type  of  service  have  any  special 
advantages? 


Yes 

~T 

(194b)  What  kind  of  advantages? 
HAVE  R EXPLAIN  IN  DETAIL 


(1^4 


No 


4c)  Why  not?. 


TERMINATE 





APPENDIX  B 


Interview  Schedule  to  be  Used  for 
Technical  Support  Personnel 


1 


INTERVIEW  SCHEDULE  DSA900-75-C-5161 

FOR  SUPPORT  PERSONNEL 

DOD  INSTALLATIONS  AND  DOD  CONTRACTOR  PERSONNEL 


(1)  Please  turn  to  Card  lA.  Here  are  some  of  the  kinds  of  Information 
that  are  typically  available  to  libraries.  Which  of  these  have 
your  users  relied  on  most  often?  (RECORD  RANKINGS  BELOW) 


(2)  Why  do  you  think  they  find  ( so  useful? 

FORMAT  #1 


(3)  Are  there  any  disadvantages? 


(WHEREVER  QUESTIONS  ARE  NOT  ANSWERED  INDICATE  SAME  WITH  A STRAIGHT  45*^  LINE  FROM  RIGHT  TO 
LEFT  DRAWN  THROUGH  THE  UNANSWERED  QUESTIONS.) 

(4)  What  percentage  of  the  information  they  reed  typically  comes  In  the 

form  of  ( )? 

FORMAT  H X 


(5)  Why  do  you  think  they  find  ( ) so  useful? 

FORMAT  #2 


OMli  Approval  No.  7^004 


FACE  SHEET 
DSA  900-75-C-5161 


Ini 

' ' 'i.iiion  not  to  be  keypunched 

1. 

Cate  of  interview 

2. 

Time  interview  be^an 

3. 

Time  interview  ended 

4. 

Interviewer's  name 

5. 

Name  of  respondent 

6. 

Respondent's  orsanization 

Information  to  be  keypunched 

1. 

MIL/GS  rating 

2. 

What  is  vour  iob  title? 

3. 

Sex 

4, 

Year  of  birth 

5. 

HiRhest  deRree  (s) 

6. 

Year  (s)  obtained 

7. 

Academic /Professional 

8. 

Number  of  personnel  supervised 

9. 

Years  of  experience  in  R&D 

10. 

Check  one:  confidential  secret 

Cop  secret 

11. 

In  a few  words  please  tell  mo  what  you  do  on  your  job. 

12. 

Organization 

s User  Code 

13. 

Contractor  or 

Dod  Organization 

14, 

Key  user  organization  or 

all  the  rest 

15. 

State: 

16. 

Area  Code: 

17. 

Interviewer ' i 

Code  # : 
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(6)  Are  there  any  disadvantages? 


(7) 


What  percentage  of  the  information  the  typical  user  needs 

comes  in  the  form  of  ( )? 

FORMAT  n X 


(8a)  Do  your  users  maintain  personal  collections  or  files? 

(8b) ^Yes  (8c)  ^No 

What  percentage  of  them  Why  not?  

maintain  such  files? 


X 


GO  TO  Q#9 


00  TO  Q#13 


(9)  Why  do  they  maintain  personal  collections  or  files? 


(10)  How  are  they  typically  organized? 


(11)  Do  they  include  microfiche? 

Yes  No 


(12a)  Do  you  think  they  could  use  assistance  in  organizing  their  collections? 

Yes  No 


(12b)  What  kind  of  assistance?  (12c)  Why  not? 


(IF  R HAS  MENTIONED  USING  A MECHANIZED  INFORMATION  SERVICE,  ASK  Q//13  THRU  //21c.  IF  NOT,  ASK 
IF  HE  HAS  EVER  USED  ONE.  IF  SO,  IDENTIFY  THE  SERVICE  AND  ASK  QUESTIONS  f/13-//21c.  IF  NOT, 
PROCEED  WITH  QUESTION  //22.) 
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Name  of  service  not  previously  Identified: 


(13)  Now  I'd  like  to  ask  you  about 

). 

MENTIONED  ABOVE 


INSERT  MECHANIZED  INFORMATION  SERVICE 


Who  Initiated  the  search,  yourself  or  someone  else? 

^Yourself  ^Someone  else 

(14)  Please  turn  to  Card  2A.  How  was  the  search  Initiated? 


(15)  What  percentage  of  the  titles  delivered  are  typically  of  real  use  to 

your  users?  X 

(16)  Generally  speaking,  how  long  does  It  take  for  them  to  screen  the 
titles? 


Hours  ^Minutes 


(17)  Is  it  generally  necessary  to  go  to  other  sources  to  complete  their 
search? 


Yes 


No 


(18)  Why  is  it  necessary? 


(19)  Please  refer  to  Card  //3A.  In  your  opinion,  how  satisfactory  has  the 
performance  of  the  mechanized  Information  service  (s)  been? 

INSERT  CARD  //3A 


Explain: 
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(20)  How  much  time  Is  typically  Involved  from  the  Initiation  of  the  request 
until  the  Information  Is  received? 

Days  Hours 

(21a)  Docs  the  information  typically  arrive  In  time  to  be  of  use  to  your 
users? 

Yes  _No 


(21b)  How  much  faster  would 
It  have  to  arrive? 


(21c)  Do  you  know  why  it  takes 
so  long?  


(22)  Please  turn  to  Card  /MA.  Please  rank  the  media  your  users  have  relied 
on  most  during  the  past  year? 

Medium  X 

1st 


2nd 


3rd 


4th 


(DO  NOT  BE  CONCERNED  IF  R CANNOT  IDENTIFY  A 3rd  OR  4th  CHOICE) 

(23)  Now»  what  percentage  of  the  information  your  users  needed  came  to  them 

as  ( ),  ( etc.  1st X 

INSERT  FIRST  CHOICE, Q#22  SECOND  CHOICE,  Q#22  2nd X 

3rd X 

4th X 

(24)  Please  turn  to  Card  for  the  next  series  of  questions.  Now  please 
think  about  all  of  the  information  your  users  needed  and  searched  for 
during  the  past  year.  To  what  extent  did  the  amount  of  Information 
they  received  meet  their  needs? 


RE-INSERT  CARD  ^3A 
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(25) 

(26) 

(27) 

(28) 

(29) 

(30) 
(31a) 

(32a) 


To  what  extent  did  the  quality  of  Information  they  received  meet 
their  needs? 


RE-INSERT  CARD  if3k 


To  what  extent  did  the  time  between  their  Initial  request  and  the 
delivery  of  the  Information  meet  their  needs? 

Re-INSERT  CARD  lf3A  

Now  please  turn  to  Card  itSA.  To  what  extent  was  the  Information 
they  received  up-to-date? 

RE-INSERT  CARD  #5A  

Now  please  go  back  to  Card  03A.  To  what  extent  did  the  media  In 
which  they  received  Information  meet  their  needs? 

RE-INSERT  CARD  tf3A  

To  what  extent  did  the  formats  meet  their  needs? 

RE-INSERT  CARD  #3A 


How  much  did  the  mechanized  Information  services  you  received  from 

( ) cost  you  (or  your  organization)? 

INSERT  SOURCE  (S) 

(30a)  ( ) (30b)  ( ) 

1 St  SOURCE  2 nd  SOURCE 

Would  your  users  be  willing  to  pay  more  to  Improve  the  ( 

) of  the  Information?  INSERT  LOWEST 

RATED  ASPECT  Q//2A-29 

(31b)  How  much  more?  (31c)  Why  not? 

In  absolute  terms; 


Percentagewise: 

(If  appropriate)  Would  your  users  be  willing  to  wait  longer  to  Improve 

the  ( ) of  the  Information? 

INSERT  LOWEST  RATED  ASPECT  Q#2A-29) 

Yes  No 


(32b)  How  much  longer?  (32c)  Why  not? 

In  absolute  terms:  


Percentagewise : 


Page  6 


(33)  Now  I would  like  you  to  project  yourself  backward  In  tine  to  1970.  I 
would  like  to  get  an  idea  of  how  the  Information  your  users  obtained 
then  and  the  way  that  they  went  about  finding  it  compares  to  the 
Information  they  obtained  this  year  and  the  way  they  found  it.  First, 
were  you  engaged  in  providing  information  support  service  five  years 
ago? 

Yes  No  (GO  TO  Q//43) 

(34)  As  much  as  possible  I would  like  you  to  think  about  the  major  research 
projects  you  were  helping  your  users  find  information  for  during  1970. 
Can  you  tell  me  what  they  were?  (USE  WHATEVER  MEMORY  JOGGERS  MAY  BE 
NECESSARY.) 


(35)  Please  turn  to  Card  #3A.  In  terms  of  their  needs  back  in  1970.  to  what 
extent  did  the  amount  of  information  received  meet  their  needs? 

RE-INSERT  CARD  #3A  


(36)  In  terms  of  their  needs  back  in  1970.  to  what  extent  did  the  quality 
of  information  received  meet  their  needs? 

RE-INSERT  CARD  #3A  


(37)  In  terms  of  their  needs  back  in  1970.  to  what  extent  did  the  time 
' between  initial  request  and  delivery  of  the  information  meet  their 
needs? 


RE-INSERT  CARD  #3A 

(38)  Now,  please  turn  to  Card  #5A.  In  terms  of  their  needs  back  in  1970.  to 
what  extent  was  the  information  they  obtained  up-to-date? 

RE-INSERT  CARD  95A 

(39)  Turn  to  Card  (f4A.  What  was  the  predominant  medium  of  the  information 

they  received?  • 

RE-INSERT  CARD  #4A  


(40)  Turn  to  Card  (*1A.  What  was  the  predominant  format  of  the  information 
they  received? 


RE-INSERT  CARD  #1A 
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(41)  Turn  to  Card  ifik.  To  what  extent  did  the  medium  meet  their  needs? 

RE-INSERT  CARD  lif3A  

(42)  To  what  extent  did  the  format  meet  their  needs? 

RE-INSERT  CARD  l!>3A 


(READ  THE  FOLLOWING  SLOWLY  TO  R) 

(43)  We've  covered  a lot  of  questions  so  far.  You  have  given  me  a lot  of 
,very  useful  information.  Now,  I'd  like  to  shift  gears  for  a moment. 

Are  you  comfortable?  Okay,  take  a breather,  flex  your  muscles  and  sit 
back  In  your  chair.  I'm  going  to  ask  you  to  stretch  your  mind  a bit, 
think  about  the  future  and  Imagine  what  It  might  be  like.  Do  you 
remember  the  book  Future  Shock?  Do  you  remember  the  major  points  the 
author  was  making?  (INTERVIEWER  EXPLAINS  AS  NECESSARY)  Now  please 
try  to  anticipate  your  users  needs  for  Information  as  they  will  be 
five  years  from  now.  In  doing  so,  please  try  to  compare  what  you  and 
your  users  have  experienced  this  year  In  receiving  Information  to 
what  you  think  their  needs  will  be  in  1980.  Do  you  think  that  you 
understand  what  I want  you  to  do? 

Yes  .No 

’ "NO" , INTERVIEWER  MUST  EXPLAIN  PROCESS  IN  MORE  DETAIL 

(44)  Okay,  I'd  like  you  to  project  yourself  into  the  future  to  1980,  How  do 
you  think  Information  services  will  have  changed  by  then? 


(45)  What  do  you  think  you  will  be  doing  then? 


lETERMINE  IF  R FEELS  COMFORTABLE  WITH  THIS  LINE  OF  QUESTIONING) 

F NO,  INTERVIEWER  MUST  EXPLAIN  PROCESS  IN  MORE  DETAIL? 

(46)  Please  turn  to  Card  ii'6A.  Would  the  amount  of  information  your  users 
have  received  this  year  meet  your  needs  in  1980? 


RE-INSERT  CARD  i!>6A 
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(47)  Would  the  quality  of  Information  they  received  this  year  meet  their 
needs  In  1980? 

RE-INSERT  CARD  if 6k  


(48)  Would  the  time  between  their  Initial  request  and  delivery  of  the  Informa- 
tion this  year  meet  their  needs  In  1980? 

RE-INSERT  CARD  //6A  * 


(49)  Would  the  extent  to  which  the  information  received  this  year  was  up- 
to-date  meet  their  needs  In  1980? 

RE-INSERT  CARD  ifSk  


(50)  Would  the  predominant  format  of  the  information  received  this  year  meet 
their  needs  In  1980? 

RE-INSERT  CARD  Hk  ■ 


(51)  Would  the  predominant  medlvim  of  the  Information  received  this  year  meet 
their  needs  In  1980? 

RE-INSERT  CARD  if6k  


(52)  Would  you  like  to  see  any  changes  in  the  amount  of  Information  received 
by  1980? 

Yes  (Be  specific)  No 


(53)  Would  you  like  to  see  any  changes  in  the  quality  of  information  received 
by  1980? 

Yes  (Be  specific)  No 


(54)  Would  you  like  to  see  any  changes  in  the  time  between  request  and  delivery 
by  1980? 


_Yes  (Be  specific)  No 


(55)  By  1980,  would  you  like  to  see  any  changes  In  the  degree  to  which  the 
Information  received  is  up-to-date? 

Yes  (Be  specific)  No 


(56)  Would  you  like  to  see  any  changes  in  the  medium  in  which  you  receive 
Information  by  1980? 

Yes  (Be  specific)  No 


(57)  Would  you  like  to  see  any  changes  in  the  format  of  the  information  you 
receive  by  1980? 

Yes  (Be  specific)  No 


(58)  Which  of  the  changes  you'd  like  to  see  would  be  most  useful  to  your 
users? 

(Explain)  I 


(59a)  Would  your  users  be  willing  to  pay  more  for  this  change? 

« 

(59b)  Yes  (59c)  No 

How  much  more?  __________  Why  not?  _________ 
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(60a)  (If  appropriate)  Would  your  users  be  willing  to  wait  longer  from 
initial  request  to  time  of  delivery  for  this  change? 


(60b)  Yes 

How  much  longer? 


(60c)  

Why  not? 


(61)  Now  please  turn  to  Card  //7A.  In  the  future  what  do  you  think  will 

happen  to  your  users'  need  for  subscription  services  versus  those  that 
they  receive  on  request  (or  demand)? 


(62a)  There  are  a number  of  services  which  automatically  provide  Information 
according  to  previously  registered  categories.  Do  your  users  subscribe 
to  any  such  services  now? 


(62b)  What  are  they? 


(62c)  Why  not? 


(62d)  Do  they  pay  for  them? 


(62e)  How  much  does  It  cost? 


(62f)  How  do  they  get  them? 


(63)  Do  you  know  what  the  letters  DDC  stand  for? 


(64)  Have  you  ever  seen  a report,  summary  or  bibliography  produced  by  DDC? 


(65)  If  yes,  have  you  had  occasion  to  request  any  Information  from  DDC? 


THE  BALANCE  OF  THIS  INTERVIEW  IS  FOR  ESTABLISHED  USERS  OF  DDC  ONLY 


I 


PART  II 

For  DDC  Users  Only 

(66)  Have  your  users  used  this  information  in  any  work  that  you 
have  undertaken  in  the  last  6 months? 

^Yes  No 

(67)  How  much  time  did  it  take  for  you  to  prepare  a request  for  DDC 

^H  . ^D  • M 

(68)  When  you  initiate  a search  for  information  from  DDC,  how 
do  you  usually  do  it? 

^Telephone  ^Mail  Thru  Intermediary  ^Other 

(69)  When  you  initiate  a search  for  information  from  other  sources, 
how  do  you  usually  do  it? 

i 

i 

^Telephone  Mail  ^Thru  Intermediary  ^Other 

(70)  Approximately  how  many  references  are  usually  delivered? 

(70a)  From  DDC (70b)  From  other  sources 

(71)  How  many  of  these  references  (approximately)  are  useful 
to  you? 

From  DDC  

(72)  From  other 

(73)  On  Card  #8A  you  will  find  a list  of  subject  areas  within  the 
DDC  collection.  Could  you  take  a few  minutes,  look  this  over, 
and  tell  me  which  areas  are  most  useful  to  your  users  in 
their  research? 


(74)  On  Card  #9A,  you  will  find  a listing  of  the  request  services 
provided  by  DDC.  Please  scan  the  list  and  tell  me  which  ones 
you  are  aware  of.  (INTERVIEWER  WILL  LIST) 


(7S) 


(76) 


(77) 


(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 


^Technical  Report  Program 

R§D  Program  Planning  Information 

System 

R 6 T Work  Unit  Info.  System 

Independent  Research  § Develop- 
ment Data  Bank  (IR  ^ D) 

Scheduled  Bibliographies 

RDT  § E On-Line  Retrieval  System 

Report  Bibliographies  on  Mag- 
netic Tape  (RBMT) 


Current  Awareness 

Defense  R § D of  the  '60's 

and  1970 

Defense  Retrieval  Indexing 

Terminology  (DRIT) 

Defense  Retrieval  Indexing 

Terminology  Hierarchy 
(DRIT-H) 

^DDC  Referral  Services 

Report  Bibliographies 


Now  will  you  please  rank  these  request  systems  in  terms  of  those 
that  your  users  find  to  be  most  useful? 


(1) 


(2)  

(3)  : 

Will  you  rank  those  that  they  find  least  useful?  Include  only 
those  you  are  aware  of  (RANK  LEAST  USEFUL  1st,  etc.) 


(1)  

(2)  . 

(3) 

On  Card  #10A,  you  will  find  a list  of  the  subscription  services 
provided  by  DDC.  Please  scan  the  list  and  tell  me  which  ones 
you're  aware  of. 

Automatic  Distribution  of  Documents  (ADD) 

Selective  Dissemination  of  Information  Software  Packages 
Technical  Abstract  Bulletin  (TAB)  § Indexes 
Automatic  Magnetic  Tape  Distribution  (TAB  on  Tape) 

DDC  Digest 

Recurring  Reports  (WUIS) 

Recurring  Reports  (Program  Planning) 

Current  Awareness  Bibliographies 
Recurring  Reports  (IR  6 D) 


(DOD  USERS  ONLY) 


(78)  Now  will  you  please  rank  these  subscription  services  in 
terms  of  those  that  your  users  find  most  useful? 

(1)  ^ 

(2)  

(3)  ^ • 

(79)  Out  of  those  subscription  services  that  you  are  familiar 
with,  please  rank  those  that  are  least  useful  to  you. 

(1)  (Least  useful) 

(2)  (next  to  least  useful) 


(3)  . 

1 

(80)  Now,  remember  those  questions  I asked  about  the  future,  I 

want  you  to  relax  again  and  stretch  your  mind.  What  services 
do  you  think  DDC  should  provide  in  the  future  that  are  not 
being  provided  now?  First,  tell  me  about  the  near  future, 
then  about  the  distant  future. 

(NEAR  FUTURE  EQUALS  "WITHIN  THE  YEAR") 

NEAR  FUTURE  - DISTANT  FUTURE 


(81)  Please  turn  to  Card  #11A.  How  were  you  first  made  aware  of 

( 0? 

INSERT  REQUEST  SERVICE  RANKED  #1  in  Q #75 


(82)  How  were  you  first  made  aware  of  (_ 


INSERT  SUBSCRIPTION  SERVICE 


RANKED  #1  in  Q #78 

(83)  Could  you  suggest  any  better  ways  to  make  people  aware  of 
those  services? 


(84)  Would  training,  such  as  seminars,  cassette  tapes  or  programmed 
texts  on  DDC  services  be  of  help  to  you? 


(85)  What  would  help  most  then? 


(86)  Would  you  make  use  of  (^ 
(was)  (were)  available? 


) if  (it)  (they) 


(87)  At  the  present  time  what  do  you  think  is  the  most  efficient 
way  of  getting  information  from  DDC? 


(88)  Which  one  of  all  the  DDC  services  do  your  users  find  most 
useful? 


(89)  New  I*d  like  to  ask  you  some  questions  about  ( ). 

INSERT  “answer  TC  Q #88 

(90)  Now,  turning  to  Card  #3A,  what  about  the  quality  of  informa- 
tion from  DDC? 

RE- INSERT  CARD  #3A 


(91)  What  about  the  quantity  of  information  from  DDC? 

RE- INSERT  CARD  #3A 


(92)  What  about  the  time  between  request  and  delivery? 

RE- INSERT  CARD  #3A 


(93)  What  about  the  degree  to  which  the  information  was  up-to-date?  j 

RE- INSERT  CARD  #3A  j 

(94)  Please  turn  to  Card  #1A.  What  format  does  most  of  the  infor-  | 

mation  come  in  when  you  receive  ( ) ? 

INSERT  M6'St  useful  Service  q #88  j 

RE- INSERT  CARD  #1A  i 


(95)  Turn  back  to  Card  #3A.  To  what  degree  does  this  format  meet 
your  users  needs? 

RE- INSERT  CARD  #3A  


(96)  Please  turn  to  Card  #4A.  What  medium  does  most  of  the  infor-  i 

mation  come  in  when  you  receive  ( )?  | 

insert  most  useEOl  serViCE  Q #6S  ! 

RE- INSERT  CARD  #4A  1 

I 

(97)  Please  turn  back  to  Card  #3A.  To  what  degree  does  this  | 

medium  meet  your  users  needs? 

RE- INSERT  CARD  #3A 

(AT  THIS  POINT  THE  INTERVIEWER  MUST  HELP  R SELECT  ANOTHER  INFORMATION  SOURCE  THAT  | 
IS  COMPARABLE  TO  DDC  IN  SERVICES  USED  BY“R.  R MAY  HAVE  IDENTIFIED  SUCH  A SOURCE  j 
IN  PART  1.  IF  SO,  FINE.  MERTTY  PROCEED."  IF"N0T  ASK  R IF  HE  GOES  ELSEWHERE  FOR  | 
SERVICES  SIMILAR  TO  THE  DDC  SERVICES  HE'S  JUST  DESCRIBED.)  I 


lEN,  INTERVIEWER  GOES  BACK  AND  REPEATS  ALL  QUESTIONS  90  THRU  97  FOR  THE  COMPARA- 
■ SOURCE  THAT  THE  RESPONDENT  RELIED  ON  OTHER  THAN  DDC,  SUCH  AS  NTIS,  NASA,  etc. 
ITINUE  TO  USE  SAME  CARDS.) 

(98)  

(99)  ^ 

(100)  ■ 

(101)  

(102)  _ 

(103)  ^ 

(104)  ; 


(105a)  Do  your  users  use  the  Research  and  Technology  Work  Unit  Informa- 
tion System  (WUIS)?  (BASED  ON  DD  #1498) 

• ( 

. I 

^Yes  ^No 

(105b)  Why  not? 


■ (GO  TO  #114a) 

(106)  How  often  do  they  use  WUIS?  

(107)  What  do  they  use  WUIS  for?  

(108)  Turn  to  Card  #3A  again.  I want  to  ask  you  about  WUIS  now.  To 
what  extent  did  the  amount  of  the  information  received  meet  their 
needs? 

RE- INSERT  CARD  #3A  

(109)  To  what  extent  did  the  quality  of  the  information  they  received 
meet  their  needs? 

RE -INSERT  CARD  #3A  

(110)  To  what  extent  did  the  time  between  initial  request  and  delivery 
meet  their  needs? 

RE- INSERT  CARD  #3A 


(Ill) 


Please  turn  to  Card  #SA.  To  what  extent  has  the  information  you 
received  been  up-to-date? 

RE- INSERT  CARD  #5A  

(112)  As  far  as  you  can  tell  what  percentage  of  the  work  units  your 

users  would  be  interested  in  were  covered  by  what  they  received? 

: % 

(113a)  List  advantages  of  WUIS  (ll3b)  List  disadvantages 


(114a)  Do  your  users  use  Program  Planning  Reports? 

Yes  No 


(ASK  ONLY  DOD 

PERSONNEL) 


(114b)  Why  not? 


(GO  TO  »123a) 

(115)  How  often  do  they  use  Program  Planning  Reports?  

(116)  What  do  they  use  Program  Planning  Reports  for?  

(117)  Please  return  to  Card  #3A.  I want  to  ask  you  about  Program  Planning 

Reports  now.  To  what  extent  did  the  amount  of  information  re- 
ceived meet  their  needs? 

RE- INSERT  CARD  #3A 

(118)  To  what  extent  did  the  quality  of  the  information  received  meet 
their  needs? 

RE- INSERT  CARD  #3A  ' 


(119)  To  what  extent  did  the  time  between  initial  request  and  delivery 
meet  their  needs? 


RE -INSERT  CARD  #3A 


(120)  Please  turn  to  Card  #SA.  To  what  extent  has  the  information  been 
up-to-date? 

RE- INSERT  CARD  #SA  

(121)  As  far  as  you  can  tell  what  percentage  of  the  information  your 
users  would  be  interested  in  was  covered  by  what  they  received? 


(122a)  List  advantages  of  Program 
Planning  Reports 


(122b)  List  disadvantages 


(123a)  Do  your  users  use  the  Independent  Research  and  Development  Data 
Bank  (IR  § D)? 

(ASK  ONLY  DOD  PERSONNEL) 


(123b)  Why  not? 


[GO  TO  Q #132) 


(124)  How  often  do  they  use  IR  § D?  

(125)  What  do  they  use  IR  § D for?  

(126)  Please  turn  to  Card  #3A.  I want  to  ask  you  about  IR  6 D.  To  what 
extent  did  the  amount  of  information  received  meet  their  needs? 


RE- INSERT  CARD  #3A  

(127)  To  what  extent  did  the  quality  of  the  information  meet  their  needs? 

RE- INSERT  CARD  #3A  ' 

(128)  To  what  extent  did  the  time  between  your  initial  request  and 
delivery  meet  their  needs? 

RE- INSERT  CARD  #3A 


(129)  Please  turn  to  Card  #5A.  To  what  extent  has  the  information  been 
up-to-date? 

RE- INSERT  CARD  #5A 


(130)  As  far  as  you  can  tell  what  percentage  of  the  information  your 
users  would  be  interested  in  was  covered  by  what  they  received? 

% 

(131a)  List  advantages  of  IR  § D (131b)  List  disadvantages 


V 

i 

] 


(132)  Please  turn  to  Card  #12A.  Here's  a list  of  Information  Analysis 
Centers  (lAC's)  Have  you,  or  your  users  ever  used  the  services 
of  an  lAC? 


^Yes  ^No 

(133a)  Do  you  or  your  users  use  the  the  services  of  any  of  these  In- 
formation Analysis  Centers  (lAC's)? 

INSERT  CARD  #12A 


Yes 


(133b)  Which  one  (s)? 
(LIST  NUMBERS) 


(134)  How  do  you  (they)  use  these  services? 


No 


(133c)  Why  not? 

(a)  Never  heard  of  them 

(b)  Too  expensive 

(c)  No  need 

(d)  Not  in  area  of  interest 

(e)  Other  


i 

S 

i 


-.-X 

I 

i 

i 


r 


(135)  Are  more  lAC’s  needed? 

Yes  No 

(136)  What  modifications,  if  any,  are  needed  in  the  service  IAC*s  provide? 


(137)  Do  your  users  tell  you  if  they  ever  see  references  to  their 
own  work  in  lAC  reports? 


(138)  Can  you  see  the  IAC*s  as  useful  sources  of  information  for  you 
and  your  users  in  the  future? 

% 

^Yes  ^No  Please  explain 


(139a)  What  services  is  DDC  now  providing  that  should  be  changed  or  mod- 
ified? 

(139b)  Services:  (139c)  Changes  or  Modifications: 


(140)  Do  your  users  have  access  to  a microfiche  reader? 

^Yes  ^No  (GO  TO  Q #145) 

(141)  Please  turn  to  Card  #13A.  How  available  is  this  reader?  


(142)  How  often  do  they  use  this  reader? 


(143)  How  often  did  they  use  it  S years  ago? 


(144)  How  often  do  you  anticipate  them  using  it  in  the  future,  by  1980? 


(145)  Do  your  users  prefer  to  receive  information  on  microfiche  or  in 
printed  copy? 

Microfiche  ^Printed  Copy 

(146)  If  you  and  your  users  could  substantially  reduce  the  time  lag 
between  your  initial  request  and  delivery  by  receiving  output 
as  microfiche  instead  of  paper,  would  they  be  interested? 

Yes  ^No  (GO  TO  Q #148) 

(147)  (If  appropriate)  How  many  days  earlier  would  you  have  to  receive 
the  information  in  order  for  them  to  accept  it  on  microfiche? 

^Days 

(148a)  Have  you  or  your  users  ever  failed  to  get  needed  information 
from  DDC? 

Yes  ^No  (GO  TO  Q #150) 

(148b)  Were  you  referred? 

Yes  ^No 

(149)  Was  referral  appropriate? 

Yes  No 


(150) 

(151) 

(152) 
(153a) 

(lS4a) 

(155) 

(156) 


Are  you  aware  of  information  services  that  can  bring  output 
directly  to  the  user  where  he  is  almost  immediately? 

Yes  No 

(EXPLAIN  TO  RESPONDENT)  GO  TO  Q #153 

What  kind  of  services  are  you  aware  of? 


Have  you  or  your  users  ever  used  this  (these)  service  (s)? 


(If  appropriate)  Are  you  familiar  with  the  DDC  Defense  RDT  6 E 
On-Line  System? 

Yes  ^No  • (GO  TO  Q #155) 

(153b)  Have  you  or  your  users  ever  used  it? 

Yes  ^No 

For  your  , users,  does  this  service  have  any  special  advantages? 

, Yes  , ^No 

(lS4b)  What  are  they?  


If  such  a service  could  be  precisely  keyed  to  the  interests  of  your 
users  and  be  complete,  what  would  they  be  willing  to  pay  for 
it  (or  your  organization)? 


Do  you  know  that  services  like  these  can  be  connected  to  other 
data  bases  or  libraries  switching  automatically  as  needed? 

I 

Yes  No 


(157) 

(158) 
(159a) 


Have  you  or  your  users  ever  used  such  an  information  system? 

^Yes  No 

Which  one? 


For  your  users,  does  this  type  of  service  have  any  special 
advantages? 

^Yes  ^No 

(lS9b)  What  kind  of  advantages?  (159c)  Why  not? 

HAVE  R EXPLAIN  IN  DETAIL 


TERMINATE 


APPENDIX  C. 

Pre-Mailed  Response  Cards 


APPENDIX  C.l 


Response  Cards  for  Bench  Level 
& Management  Personnel 


CARD  #1 


Very  Moderate  Some  No  need 

large  • at  all 


CARD  #2 


Part  of  the  task  assignment 


Most  authoritative 


.Most  readily  available  Remembered  that  the 

Info,  was  there 

.Had  found  other  Info,  there  ^Other  (specify) 

previously 


' % 


CARD  #3 


FORMATS 


Computer  Generated  Bibliographies 
Technical  Reports 
Personal  Conversation 
Abstract  Journals 
Published  Bibliographies  (Lists) 

.Books 

.Handbooks « Manuals 

.Management  Reports;  l.e.,  manpower,  funding,  project  status, 

resource  allocation  and  status 


Journals 

^Re Views/State  of  the  Art  papers 

. j Current  Awareness  or  Automatic. Announcement  Services 

Numeric  Data  Compilations 

^Commercial  Brochures 

Other 


CARD  #4 


CRT  ^Telephone 

Written  Request  ^Through  Intermediary 


.Other  (specify) 


CARD  #5 


Always 

Met  my 

Met  my 

Met  my 

Never 

met  my 

needs 

needs 

needs 

met  my 

needs 

more  than 

half  the 

less  than 

needs 

half  the  time 

time 

half  the 

time 

CARD  #6 


.A  lot  of  problems 
.More  problems  than  expected 
.No  more  or  less  than  expected 
.Less  problems  than  expected 
No  problems  at  all 


CARD  #7 


Information  Media 


Printed  Documents 
Microfilm 
Microfiche 
Charts 

Verbal  Communication 
Computer  Printout 


Punched  Cards 
Magnetic  Tape 
CRT  Display 
Videotape 
Audiotape 
Other 


card  #8 


Up  to  date 
all  the 
time 


Up  to  date 
more  than 
half  the 
time 


Up  to  date 
half 

the  time 


Up  to  date 
less  than 
half  the 
time 


Never 
up  to 
date 


' % 


CARD  #9 


Will  meet  my 
. needs 
all  the  time 


Will  meet  my 
needs  more 
than  half 
the  time 


Will  meet  my 
needs  half 
of  the  time 


Will  meet 
my  needs 
less  than 
half  the 


Will  never 
meet  my 
needs 


CARD  #10 


Much 

Somewhat 

No 

Somewhat 

greater 

greater 

change 

greater 

need  for 

need  for 

need  for 

subscription 

subscription 

demand 

services 

services 

services 

Much 
greater 
need  for 
demand 
services 


CARD  #11 


Extremely  Valuable  Somewhat 

valuable  valuable 


Not  at  all 
valuable 
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CARD  #13 


DDC  Services  - Availobic  on  Request 


_Technlcal  Report  Program 

_R&D  Program  Planning  Infor- 
mation System  (DD  Form  1634) 

_Research  and  Technology 
Work  Unit  Information 
System  (DDForm  1498) 

independent  Research  and 
Development  Data  Bank  (IR&D) 

Scheduled  Bibliographies 

Report  Bibliographies 


.Defense  R&D  of  the  60 's 
and  1970 

.DDC  Referral  Services 

RDT&E  On-Line  Retrieval 
System 

Defense  Retrieval  and  Indexing 
Terminology  (DRIT) 

Defense  Retrieval  and  Indexing 
Terminology  Hierarchy  (DRIT-H) 


CARD  #14 


DDC  SUBSCRIPTION  SERVICES 


(1)  Automatic  Distribution  of  Documents  (ADD) 

(2)  Selective  Dissemination  of  Information  Software  Packages 

(3)  Technical  Abstract  Bulletin  (TAB)  and  Indexes 

(4)  Automatic  Magnetic  Tape  Distribution  (TAB  on  Tape) 

(5)  DDC  Digest 

(6)  Recurring  Reports  (WUIS) 

(7)  Recurring  Reports  (Program  Planning) 

(8)  Current  Awareness  Bibliographies 

(9)  Recurring  Reports  (IR&D)  (DOD  USERS  ONLY) 


CARD  #15 


Matting  tist  I'm  on 
Telephone 


Intermediary  (librarian.  In 
formation  Officer,  etc. 
Other  (specify) 


I 


GAUD  #16 


Information  Analysis  Centers 


(1)  Machinability  Data  Center  (MDC) 

(2)  Mechanical  Properties  Data  Center  (MPDC) 

(3)  Metals  and  Ceramics  Information  Center  (MCIC) 

I (4)  Nondestructive  Testing  Data  Support  Center  (NTDSC) 

' (5)  ^Thermophysical  and  Electronic  Properties  Information  Analysis  Center  (TEPIAC) 

(6)  Chemical  Propulsion  Information  Agency  (CPIA) 

(7)  Infrared  Information  and  Analysis  Center  (IRIA) 

(8)  ^Reliability  Analysis  Center  (RAC) 

(9)  Coastal  Engineering  Information  Analysis  Center 

I (10)  Concrete  Technology  Information  Center 

j (11)  DOD  Nuclear  Information  & Analysis  Center  (DASIAC) 

(12)  Electronic  Properties  Information  Center 

(13)  Hydraulic  Engineering  Information  Analysis  Center 

(14)  ^Pavements  & Soil  Trafflcablllty  Information  Analysis  Center 

(15)  Plastics  Technical  Evaluation  Center 

(16)  ^Shock  and  Vibration  Information  Center 

(17)  ^Soil  Mechanics  Information  Analysis  Center 

(18)  ^Strategic  Technology  Office  Data  Base 

(19)  ^Tactical  Technology  Center  (TACTEC) 

(20)  Environmental  Information  Division  (Air  Force) 

(21)  ^USAF  Environmental  Technical  Applications  Center 

(22)  ^Institute  of  Polar  Studies 

(23)  Physical  Data  Group,  Lawrence  Livermore  Laboratory 

(24)  ^Radiation  Shielding  Information  Center 

(25)  X-Ray  Attenuation  Coefficient  Information  Center 

(26)  Bathythermograph  Data  Processing  and  Analysis  Facility 

(27)  Chemical  Kinetics  Information  Center 

(28)  Data  Collection  and  Processing  Group,  Scrlpps  Institution  of  Oceanography 


CARD  #17 


Readily 

Available 


Available 

Sometimes 


Seldom  Not  Available 

Available  at  All 


APPENDIX  C.2 


Response  Cards  for  Technical 
Support  Personnel 


CARD  #1A 


FORMATS 


Compvitok  Generated  Bibiloqraphlos 

Technical  Reports 

Personal  Convetsation 

Abstract  Journals 

Published  Bibliooraphies  (Lists) 

Books 

Handbooks,  Manuals 

Management  Reports:  i.e.,  manpower,  funding,  project  status, 

resource  allocation  and  status 

Journals 

Reviews/State  of  the  Art  papers  • 

Current  Awareness  or  Automatic  Announcement  Services 
Numeric  Data  Compilations 
Commercial  Brochures 
Other 


CARD#2A 


_CRT  Telephone 

__Wrmen  Request  Tl;rough  Intermedtary 

_Other  (specify) 


CARD  #3A 


Always 

Met  my 

Met  my 

Met  my 

Never 

met  my 

needs 

needs 

needs 

met  my 

needs 

more  than 

half  the 

less  than 

needs 

half  the  time 

time 

half  the 

time 

CARD  #4 A 


Information  Media 


.Printed  Documents 
.Microfilm 
.Microfiche 
.Charts 

.Verbal  Communication 
.Computer  Printout 


.Punched  Cards 
.Magnetic  Tape 
.CRT  Display 
.Videotape 
.Audiotape 
Other 


CARD#5A 


Up  to  date 

Up  to  date 

Up  to  date 

Up  tu  date 

Never 

all  the 

more  than 

half 

less  than 

up  to 

time 

half  the 

the  time 

half  the 

date 

time 

time 

CARD  #6A 


Will  meet  my 
needs 

all  the  time 


Will  meet  my 
needs  more 
than  half 
the  time 


Will  meet  my  Will  meet  Will  never 
needs  half  my  needs  meet  my 
of  the  time  less  than  needs 
half  the 
time 


CARD  #7A 


Much 

Somewhat 

No 

Somewhat 

greater 

greater 

change 

greater 

need  for 

need  for 

need  for 

subscription 

subscription 

demand 

services 

services 

services 

Much 
greater 
need  for 
demand 
services 


CARD  USA 


i ! 
Si 
15 


% 
Ss 

AC 

1*11 

I 5 e 


I 

% 

5 

1 


lo 


ifIsS  I*  :i 
it ‘‘-3  & 

Ss8;lit£oSsSs- 

8-“4J!:"£SC55;ca. 


II 

li . 

III  i 


eS8SS!S&8S 


j 

S S S t2  S o 


i 
c 

1 

5 

« 

S 
a 

c 

i I si  s 

mslid 


i 


l| 


facs  §-5|l  S I'O'S  E 

(iskhiidm! 

i ssssss&assssss 


,1- 

^ a* *: Ss5fc 

”I“S^  tti; 


5 5SJiilsSSiJoij.j^ 

^ <u wibiSixai «•!»>(£ a vi 


rl 

ll 

II 

I! 

it  SI 
1 fill, 
1 sssfi 


CARD  ^<9A 


DDC  Services  - Available  on  Request 


__Technical  Report  Program 

__R&D  Program  Planning  Infor- 
mation System  (DD  Form  1634) 

_Research  and  Technology 
Work  Unit  Information 
System  (DDForm  1498) 

_Jndependent  Research  and 
Development  Data  Bank  (IR&D) 

^Scheduled  Bibliographies 

__Report  Bibliographies 


Defense  R&D  of  the  60' s 

and  1970 

DDC  Referral  Services 

RDT&E  On-Line  Retrieval 

System 

Defense  Retrieval  and  Indexing 

Terminology  (DRIT) 

Defense  Retrieval  and  Indexing 

Terminology  Hierarchy  (DRIT-H) 


CARD#10A 


^0) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 


DDC  SUBSCRIPTION  SERVICES 

Automatic  Distribution  of  Documents  (ADD) 

Selective  Dissemination  of  Information  Software  Packages 
Technical  Abstract  Bulletin  (TAB)  and  Indexes 
Automatic  Magnetic  Tape  Distribution  (TAB  on  Tape) 

DIX3  Digest 

Recurring  Reports  (WUIS) 

Recurring  Reports  (Program  Planning) 

Current  Awareness  Bibliographies 

Recurring  Reports  (IR&D)  (DOD  USERS  ONI  V) 


CARD#11A 

Mailing  list  I'm  on 


Telophone 


.Intermediary  (librarian,  In 
formation  Officer,  etc. 
.Other  (specify) 


CARD#12A 


Information  Analysis  Centers 


(1)  MachlnablUty  Data  Center  (MDC) 

(2)  Mechanical  Properties  Data  Center  (MPDC) 

(3)  Metals  and  Ceramics  Information  Center  (MCIC) 

(4)  ^Nondestructive  Testing  Data  Support  Center  (NTDSC) 

(5)  Thermophysical  and  Electronic  Properties  Information  Analysis  Center  (TEPIAC) 

(6)  ^Chemlcal  Propulsion  Information  Agency  (CPIA) 

(7)  Infrared  Information  and  Analysis  Center  (IRIA) 

(8)  ^Reliability  Analysis  Center  (RAC) 

(9)  Coastal  Engineering  Information  Analysis  Center 

(10)  ^Concrete  Technology  Information  Center 

(11)  DOD  Nuclear  Information  & Analysis  Center  (DASIAC) 

(12)  ^Electronic  Properties  Information  Center 

(13)  Hydraulic  Engineering  Information  Analysis  Center 

(14)  ^Pavements  & Soil  Trafflcablllty  Information  Analysis  Center 

(15)  ^Plastics  Technical  Evaluation  Center 

(16)  ^Shock  and  Vibration  Information  Center 

(17)  ^Soll  Mechanics  Information  Analysis  Center 

(1 8)  ^Strategic  Technology  Office  Data  Base 

(19)  ^Tactical  Technology  Center  (TACTEC) 

(20)  Environmental  Information  Division  (Air  Force) 

(21)  ^USAF  Environmental  Technical  Applications  Center 

(22)  ^Institute  of  Polar  Studies 

(23)  Physical  Data  Group,  Lawrence  Livermore  Laboratory 

(24)  ^Radiation  Shielding  Information  Center 

(25)  X-Ray  Attenuation  Coefficient  Information  Center 

(26)  Bathythermograph  Data  Processing  and  Analysis  Facility 

(27)  Chemical  Kinetics  Information  Center 

(28)  Data  Collection  and  Processing  Group,  Scrlpps  Institution  of  Oceanography 


CARD  #13A 


Readily 

Available 


Available  Seldom  Not  Available 

Sometimes  Available  at  All 


inlormalion  and  management  Gciencos 


A 

AUERBACH 

121  n.  broad  st. 
Philadelphia 
penna.  19107 
215-491-8200 
cable:  auerinfo 


Dear 


Recently  we  began  a aeries  of  studies  to  assist  the  Department  of 
Defense  planning  for  future  technical  information  needs.  We  selected  your 
name  randomly  and  then  called  to  ask  your  participation  in  one  of  a series 
of  interviews  which  will  be  a major  part  of  the  planning  studies.  Enclosed 
with  this  letter  you  will  find  a package  of  cards  that  wt  would  like  you 
to  keep  at  your  desk,  so  they  will  be  available  when  we  call  you.  The 
interview  will  be  conducted  by  phone,  but  the  cards  will  make  it  easier  for 
you  to  give  your  answers. 

One  of  the  project  interviewers  at  AUERBACH  will  try  to  call  you 
on  . If  we  don't  reach  you  then  we'll  call  you 

. We'll  be  asking  you  questions  about  the 
information  needs  that  you  need  in  your  work. 

AUERBACH  is  pleased  to  have  you  as  a participant  in  this  project. 

When  the  results  and  tabulations  are  reported  to  DoD  only  group  frequencies 
and  results  will  be  included.  Our  professional  ethics  and  the  contract  we  have 
withDoD  protects  the  integrity  of  your  responses,  and  guarantees  complete 
confidentiality. 

We  shall  look  forward  to  talking  with  you. 

Sincerelv, 

AUERBACH  Associates,  Inc. 


Jerome  T.  Maddock 
Consultant 

Research  and  Deyelopment  Division 

JTM:lls  Philadelphia 

Washington 
now  york 
london 


APPENDIX  E 


Justification  of  Survey  Plan 


Appendix  E. 

JUSTIFICATION  OF  PURVEY  PLAN 


1.  Justification  for  the  Sampling  Methodology 

AUERBACH  chose  a stratified  san^llng  plan  with  provisions  for  random 
selection  within  each  group  In  order  to  ensure  that  a number  of  categories  of 
interest  to  DoD  would  be  included  In  the  final  sanple.  These  categories  comprise 
the  strata  within  the  overall  sampling  plan.  The  plan  calls  for  the  following 
strata:  users  vs.  non-users^  those  In  key  user  organizations  vs.  those  In  all 

other  organizations;  DoD  vs.  contractors;  and  bench  level  vs.  management  level 
vs.  support  personnel.  This  sampling  plan  strikes  a balance  between  the  need  to 
Include  a number  of  Important  categories  and  the  problems  that  arise  when  too 
many  categories  are  included  In  the  plan. 

Specifically,  there  are  potentially  dozens  of  variables  that  could 
be  Included  In  a sampling  plan  for  this  project.  Since  there  Is  a practical 
limit  to  the  number  of  interviews  that  can  be  conducted,  it  Is  not  possible  to 
1 nclude  more  than  about  four  of  the  many  variables  that  could  be  of  interest  to 
DoD.  To  include  more  than  four  variables  would  also  reduce  the  size  of  each 
group  within  the  sample  and  thereby  drastically  reduce  the  reliability  of  the 
results  to  a point  that  Is  below  acceptable  guidelines. 


While  It  is  clear  that  some  of  the  groups  in  the  sampling  plan  are 
much  larger  in  the  universe  from  which  wo  are  sampling,  it  is  not  known  at 
this  time  hen;  much  larger  one  group  is  than  another.  AUERBACH  will  allow  for 
these  differences  by  utilizing  a sampling  fraction  to  be  determined  once  the 
ratio  between  the  two  groups  is  established.  For  example,  there  may  be 
seven  times  as  many  bench  level  personnel  as  managers  in  th  population.  If 
so,  we  would  want  to  interview  more  bench  level  personnel  ,iian  managers.  Inter- 
viewing seven  times  as  many  bench  level  personnel  as  managers,  however  would 
introduce  another  problem.  Specifically,  each  group  of  manager^  could  be  so 
small  that  estimates  of  error  for  their  results  would  be  too  high.  Therefore, 
we  shall  select  a sampling  fraction  which  minimizes  estimated  error  for  both  groups 
without  requiring  us  to  Interview  the  same  number  of  managers  and  bench  level 
personnel.  Then,  in  order  to  obtain  an  aggregate  sample  for  overall  results, 
the  responses  of  each  group  will  be  weighted  in  order  to  reflect  their  proportion 
in  the  population.  This  procedure  will  maximize  the  accuracy  of  our  results, 
and,  in  turn,  maximize  the  accuracy  of  predictions  and  extrapolations  that  are 
based  upon  the  results. 

Although  it  is  not  possible  to  include  all  variables  in  the  sampling 
plan,  this  does  not  mean  that  we  cannot  analyze  the  effects  of  these  variables. 

In  the  section  that  describes  our  statistical  analysis  and  presents  the  justifi- 
cation for  the  same,  it  will  be  shown  that  It  is  possible  to  analyze  the  effects 
of  all  of  the  variables  that  are  of  interest  to  DDC. 

In  conclusion,  AUERBACH  has  designed  a sampling  plan  which  is  scien- 
tifically rigorous,  yet  meets  the  needs  of  the  proposed  project.  The  plan 
balances  the  advantages  of  very  large  samples  against  the  advantages  of  including 
major  variables  of  Interest  as  strata  in  the  sampling  design. 

2.  Justification  of  the  Combined  Telephone-Mail  Survey  Questionnaire 

And  Interview 

The  survey  methodology  for  this  project  will  combine  the  advantages 
of  a mailed  questionnaire  and  telephone  survey  and,  at  the  same  time,  eliminate 
the  disadvantages  of  each.  In  addition,  the  combined  method  that  we  will  employ 
is  designed  to  reduce  the  considerable  expense  that  would  be  involved  in  con- 
ducting face-to-face  or  personal  interviews  with  each  subject. 

Specifically,  the  number  of  parameters  associated  with  the  population 
that  is  of  interest  in  this  study  is  so  broad  that  the  choice  of  a representative 


sample  is  imperative.  This  means  that  the  individuals  who  will  eventually  be 
selected  for  interviewing  will  be  spread  over  a wide  geographic  area,  and  the 
expense  of  sending  interviewers  to  all  locations  would  be  prohibitive.  Further- 
irre,  the  advantages  of  a face-to-face  interview,  such  as  personal  contact,  behav- 
ioral obsei-vation,  etc.  are  not  justified  in  terms  of  the  desired  outcomes  and 
objectives  of  this  project.  Therefore,  respondents  could  be  contacted  either  by 
telephone  or  by  mail.  These  two  methods  have  the  obvious  advantage  of  reducing 
cost,  but  either  method  by  itself  contains  some  rather  decided  disadvantages. 

The  major  disadvantage  of  the  use  of  mailed  questionnaires  is  the 
Imited  response,  which  may  range  from  57.  to  507..  Even  at  the  upper  limits  of 
responding,  one  is  forced  to  raise  questions  regarding  the  unknown  differences 
between  those  who  respond  and  those  who  do  not.  On  the  other  hand,  telephone 
interviews,  while  assuring  cooperation  in  terms  of  response,  have  the  decided 
disadvantage  of  being  unable  to  Impose  a set  of  response  categories  on  the 
respondent.  Such  a categorization  is  often  necessary  in  order  to  derive  answers 
that  may  be  quantified  and  entered  into  an  overall  statistical  analysis.  For 
exan^le,  a telephone  respondent  is  asked  if  he  plans  to  purchase  a new  car,  and 
is  given  the  following  response  categories: 

Within  three  to  six  months 
Within  six  months  to  one  year 
Within  one  to  two  years 
Within  two  to  three  years 
Three  years  or  more 

Research  has  demonstrated  that  more  than  half  of  all  respondents  will 
answer  "three  years  or  more"  when  they  are  contacted  by  telephone,  simply  of 
the  "recency"  effect;  i.e.,  they  answer  in  terms  of  the  most  recent  category 
that  was  presented,  having  forgotten  all  of  the  rest.  In  other  words,  memory 
accounts  for  a considerable  portion  of  the  variance  in  the  results  of  sucb  a 
study.  The  telephone  interview,  then,  has  a decided  disadvantage  since  the 
questions  cannot  be  answered  in  terms  of  a useful  survey  format. 

For  this  project,  we  are  proposing  that  the  combined  use  of  mailed 
questionnaire  responses  and  telephone  interviews  will  eliminate  the  dis- 
advantages of  either  approach  by  itself  and  at  the  same  time  eliminate  the 
expense  of  personal  Interviews.  In  addition,  this  methodology  allows  us  to 
draw  a sample  from  a full  range  of  respondents  without  costly  restrictions. 


The  mailed  questionnaire- telephone  sequence  proceeds  ns  follows: 


(1)  Respondents  are  contacted  by  telephone  and  asked  to  participate 
in  the  survey.  Upon  agreement,  a telephone  interview  date  and 
alternate  date  are  established. 

(2)  Respondents  receive  in  the  mail  a packet,  containing  the 
following  items: 

(a)  A letter  explaining  the  purpose  of  the  survey. 

A sample  of  this  letter  is  enclosed  for  examination  in 
Appendix  D . 

(b)  A number  of  cards,  upon  which  response  categories  are 
found.  (Appendix  C) 

(c)  A confirmation  of  the  telephone  interview  date,  and  its 
alternate. 

(d)  An  explanation  of  the  respondent's  rights  under  the  Privacy 
Act. 

In  the  methodology,  the  respondent  is  not  required  to  mail  completed 
questionnaires,  thereby  eliminating  the  bias  that  would  occur  as  a function  of 
cooperation.  Furthermore,  the  response  categories  that  are  sent  out  do  not 
suggest  the  nature  of  the  content  of  the  questions,  so  that  the  respondent  can- 
not "prepare"  his  answers  before  the  interview. 

At  the  time  of  the  interview,  the  interviewer  will  ask  three  types 
of  questions:  (1)  questions  that  may  be  answered  in  a straightforward  "yes-no" 

format;  (2)  questions  that  require  some  elaboration;  and  (3)  qxjestlons  that  may 
be  answered  in  terms  of  the  predetermined  response  categories.  Since  the 
respondent  will,  at  the  time  of  the  interview,  have  access  to  the  predetermined 
response  categories,  it  will  not  be  necessary  to  rely  upon  his  memory,  or 
for  the  interviewer  to  repeat  the  categories  over  and  over.  Instead,  he  is 
simply  instructed  to  respond  in  terms  of  the  designated  card,  choosing  the 
response  category  that  he  feels  is  most  appropriate.  The  methodology  that 
AUERBACH  has  developed  is  designed  to  save  both  money  and  time  as  well  as  to 
eliminate  a considerably  large  source  of  variance  which  results  from  a 
reliance  upon  the  respondent's  memory  in  order  to  gather  objective  responses. 
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Justification  for  Statistical  Analysis 


AUERBACH  has  developed  a strategy  for  data  analysis  that  will  (1)  mini 
mize  the  number  of  necessary  computations;  (2)  reduce  the  computer  time  to  a 
minimum  and  (3)  provide  all  of  the  information  that  is  needed  without  missing 
any  of  the  critical  variables. 

The  strategy  consists  of  these  steps:  (1)  analysis  of  the  dependent 

variables  defined  in  terms  of  interview  questions;  (2)  analysis  of  trends  across 
tinxj  for  selected  variables;  and  (3)  extrapolation  from  linear  and  curvilinear 
trends  to  make  projections  for  future  user  needs. 

First,  the  respondents'  answers  to  each  question  on  the  interview  will 
be  analyzed  using  multivariate  techniques.  All  variables  of  potential  interest 
to  DDC  will  be  included  as  predictors  In  a multiple  regression  analysis  in  order 
to  determine  the  degree  to  which  each  variable  can  predict  or  account  for  the 
differences  among  respondents  in  the  way  they  answered  the  questions.  This 
procedure  has  the  advantage  of  including  all  of  the  categories  in  the  sampling 
plan  as  well  as  all  other  variables  of  interest.  Once  this  has  been  done,  the 
four  most  powerful  predictors  will  be  selected  as  factors  in  an  analysis  of 
variance  design.  R .sponses  to  each  Interview  question  will  again  serve  as  the 
dependent  variables.  This  second  step  will  allow  us  to  examine  the  interaction 
among  the  most  significant  variables  influencing  answers  to  each  question  in 
the  interview.  Examining  these  Interactions  could  not  be  done  efficiently  using 
multivariate  techniques.  In  addition,  this  procedure  will  add  explanatory 
power  beyond  that  provided  by  the  predictors  identified  by  regression  analysis. 

The  second  step  in  our  analysis  will  be  to  determine  trends  over  time 
for  user/non-user  satisfaction  (l.e.,  satisfaction  with  quantity,  quality,  re- 
sponse time,  medium  format,  etc.).  Trend  analysis  will  be  perfomed  on  each 
dependent  variable  in  order  to  determine  the  linearity  and/or  curvll inear ity 
of  the  trends.  In  addition,  variables  identified  in  the  first  step  of  our 
strategy,  will  be  included  as  factors  in  the  design  of  the  trend  analysis.  The 
trend  analysis  will  allow  us  to  determine  whether  the  demands  for  various  as- 
pects of  Information  service  are  stable,  whether  they  are  increasing  in  a linear 
fashion  or  whether  they  are  increasing  in  a curvilinear,  ever  rising  fashion. 

Determining  the  trends  for  these  services  will  alliw  us  to  move  to  the  third 
* 

step  of  our  strategy,  which  is  the  relatively  precise  prediction  of  user  needs 
in  1988. 


The  third  step  In  the  analysts  is  the  prediction  of  future  needs 
of  users  and  non-users.  These  predictions  will  be  based  on  extrapolation  from 
the  trend  lines  that  are  established  in  the  second  step.  Extrapolations  will 
be  made  utilizing  a least  squares  solution,  which  will  find  the  best  fit  curve 
line,  given  the  existing  data  points.  Therefore,  a precise  extrapolation  beyond 
the  1980  points  toward  1988  can  be  made.  Based  on  the  extrapolated  line  or 
curve,  predictions  can  then  be  made. 

The  advantage  of  this  technique  is  that  the  predictions  that  will  be 
made  will  be  based  on  a reliable  and  empirically  developed  data  bank  of  past, 
present  and  future  users/non-users  needs.  No  predictions  will  be  made  on  the 
basis  of  subjective  impressions,  hunches  or  speculation. 

In  conclusion,  AUERBACH  has  developed  a methodology  which  will  come 
as  close  as  the  scientist  can  to  predicting  the  future. 
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SECTION  I.  INTRODUCTION 


The  Expert  Panel  Review  Report  Is  an  interim  document.  It  presents 
the  results  of  one  major  task  in  AUERBACH* s long  range  planning  study  for  the 
Defense  Documentation  Center  under  Contract  No,  DSA900-75-C-5161.  The  con- 
clusions and  recommendations  discussed  in  this  volume  are  directed  toward 
predicting  the  likely  course  of  advancement  df  Information  processing 
technology. 

1.1  PURPOSE  AND  USE  OF  THE  TECHNICAL  NOTE 

This  document  is  Intended  to  be  used  primarily  by  DDC  and  the  project 
team  to  formulate  a set  of  reasonable  time-phased  assumptions  about  future  Infor- 
mation technology,  information  organisations,  and  economic  factors.  As  a pro- 
ject document,  the  Expert  Panel  Review  Report  serves  as  an  outline  of  future 
developments,  which  will  Influence  the  final  recomnendatlons  of  the  comprehensive 
study  now  underway  for  the  target  period  1978-1988.  For  this  review,  the 
results  of  a literature  survey,  an  Interagency  survey  and  an  Internal  review 
of  DDC  plans  and  operations  have  been  converted  to  a select  list  of  future 
events  that  are  expected  to  be  especially  relevant  to  the  DoD  RDT&E  Informa- 
tion processing  and  using  community.  However,  some  of  the  conclusions  have  a 
generality  about  them  that  could  have  Implications  beyond  DoD.  Tnus,  agencies 
other  than  DoD  agencies  may  find  these  results  of  Interest. 
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EXPERT  PANEL  REVIEW  SUMMARY 


Highlights  of  the  Expert  Panel  Review  and  AUERBACH* ■ conclusions 
and  Interpretation  are; 

# Important  Trends 

- Scientific  bibliographic  Information  systems  are  following 
a trend  that  will  eventually  result  In  a comprehensive, 
International,  cross  disciplinary  and  Integrated  data  resource 
that  will  be  accessible  to  Individuals  through  single  access 
points 

The  highest  payoff  area  for  Increased  scientific  and  technical 
Information  service  Is  factual  data  services  that  are  non- 
blbllographlc 

Information  analysis  services  will  be  an  Increasingly 
Important  component  of  total  technical  Information  systems 

> The  application  of  electronic  devices  to  the  control  and 
manipulation  of  Information  data  la  a dominant  trend.  The 
particular  devices  themselves  are  basically  of  Incidental 
Importance.  It  is  the  applications  techniques  for  infoma* 
tlon  handling  that  facilitate  total  electronic  control  of 
technical  Information  processes  that  are  among  the  most 
Important  matters  to  be  resolved. 


Technology 

- Large  computers  designed  specifically  for  textural  informa- 
tion processing  are  unlikely.  Peripheral  and  decentralised 
special  purpose  units  are  desirable  and  feasible 

complete  electronic  control  over  Infoimatlon  processing  opera- 
tions Is  desirable.  A number  of  approaches  are  feasible 
depending  on  various  system  requirements 

Electronic  storage  and  dissemination  media  will  virtually 
supplant  microform  media 

Organisational  Structures  and  Affiliations 

- Interorganlaatlonal  cooperation  and  standardisation  Is  funda- 
mental to  the  advancement  of  Information  processing  technology 
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Economict 


- Cost  «lon«  li  not  a barrier  to  the  advancement  of  information 
procaaaing  technology 

a Services 

• New  coacepta  in  service  are  seen  as  highly  desirable 

and  feasible  but  a perplexing  pessimism  is  expressed  con- 
cerning the  ability  of  the  information  comnunlty  to  develop 
them 

- Widespread  accessibility  to  many  data  bases  is  a highly 
desirable  objective 

- Fact  services  are  a conspicuous  gap  in  current  information 
servic«is 

e Time-Phased  Goals 

- Quantum  advancement  of  information  processing  technology  is 
not  seen  before  1985.  Interim  progress  may  be  characterised 
by  standardization  and  expanded  bibliographic  Information 
services  involving  multiple  data  base  access  and  Interactive 
search  capability 

1.3  METHODOLOGY 


The  method  used  by  AUERBACH  to  conduct  the  Expert  Panel  Review  is  a 

modified  composite  of  two  Delphi-like  approaches:  (a)  the  SEER  (System  for 

Event  Evaluation  and  Review)  approach  developed  and  employed  for  technology 

a8<^eS8mant  by  Bernstein,  et  al^  of  the  Naval  Supply  Systems  command,  and  (b) 

2 

the  Probe  II  methodology  of  the  TRW  Corporation  employed  by  North  and  Pyke. 
Auerbach's  composite  methodology  consists  basically  of  four  steps: 

(a)  Df^velopment  of  a compendium  of  factual  data  and  potential 
events,  and  distillation  of  this  data  into  an  original 
Events  List.  (Discussed  in  Section  1.3.1  below). 


^ Bernstein,  G.  B.  et  al.  A Fifteen-Year  Forecast  of  Information  Proce.?a.ing 

Technology.  Washington,  D.C.,  Naval  Supply  Systems  Command,  1969.  (AD  681752). 

2 

North,  H.  Q.  and  Pyke,  D.  L.  "Probes  of  the  Technological  Future."  Harvard 
Business  Review.  47(3):68-82,  May-June  1969. 
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<b)  (Round  I)  Evaluation  cf  this  original  Events  List  by  experts 
involved  in  information  transfer  at  the  R&D,  operations  and 
product  planning  levels.  (Discussed  in  Section  1.3.2  below). 

(c)  (Round  II)  Modification  of  the  Events  List  based  on  the  results 
of  Round  I,  and  re-evaluation  of  this  new  Events  List  by  a second 
round  panel  of  specialists  in  information  technology  and  indivi- 
duals in  influential  information  science  positions  who  are  con- 
cerned with  long  range  planning  and  administration  (Discussed 

in  Section  1.3.3  below) 

(d)  Analysis  of  results,  definition  of  the  state-of-the-art  and 
definition  of  potential  alternative  short,  mid-  and  long-range 
goals  and  identification  of  events  necessary  or  desirable  to 
support  these  goals. 


1.3.1  Development  of  the  Events  List 


A Literature  Survey  generated  a list  of  about  70  "raw"  events  cover- 
ing technological  trends  and  future  predictions  for  the  information  conmunlty. 
These  "raw"  generalized  events  were  then  distilled  into  41  events,  which  were 
seen  as  the  most  relevant  and  specific  to  DDC's  plans  and  Interests.  This  was 
done  through  the  following  steps: 

e Close  inspection  of  all  available  DDC  descriptive  and  planning 
documents  to  isolate  areas  of  high  interest  for  DDC 

e Review  of  the  documentation  of  the  Interagency  Survey  (a 
related  task  under  the  present  contract),  to  point  out 
developments  in  all  ed  organizations  which  would  be  most 
likely  to  Impact  on  DDC. 

a Formulation  of  a aeries  of  questions  in  connection  with  the 
areas  of  interest  (uncovered  as  described  above)  representing 
planning  options  for  DDC  (Shown  in  Appendix  D) 

a Translation  of  the  questions  into  a list  of  carefully  worded 
events,  designed  to  elicit  maxlum  feedback  relevant  to  the 

DDC  plans. 


1.3.2  Round  1 


Round  I procedures  were  as  follows: 

(a)  Selection  of  Round  I Participants 

The  Round  I participants  were  selected  to  provide  expertise  at 
the  operation  or  system  design  level,  such  as  practitioners  and 
researchers  in  various  phases  or  aspects  of  Information  science 
(e.g.,  program  managers  of  significant  information  systems  and 
academic  researchers).  Effort  was  made  to  achieve  a broad 


1-4 


coverage  of  many  organlaatlona.  Of  the  10  Round  I participants, 
five  repreaentad  government  agencies,  three  represented  private 
"for  profit"  companies,  and  two  represented  academic  institutions. 

(b)  Solicitation  of  Responses 

The  Round  I Events  List  was  mailed  to  all  participants.  Approxi- 
mately five  days  later,  an  AUERBACH  representative  visited  each 
participant  to  physically  collect  the  List  and  to  answer  any 
questions  the  participant  might  have.  The  visit  also  acted  as 
a deadline  so  that  the  participant  could  not  put  off  responding 
to  the  Events  List. 

(c)  Analysis  of  Round  I Responses 

The  collected  Round  I Events  Lists  were  cut  apart  so  that  each 
question  was  on  a separate  place  of  paper.  Then  all  the  "event 
number  I's"  were  clipped  together,  etc.  The  number  of  responses 
for  each  category  and  subcategory  was  tallied,  and  the  percen- 
tages calculated.  If,  for  example,  9 participants  responded  to 
the  USER  DESIRABILITY  section  of  a particular  event,  and  of 
these,  3 checked  "desirable"  then  the  percentage  of  "desirable" 
responses  for  that  event  was  337..  Years  given  In  the  PROBABLE 
TIMING  section  were  averaged  for  each  of  the  three  probabilities 
of  each  event.  The  connenta  for  each  event  were  read  care- 
fully and  analyzed  to  uncover  event  ambiguity,  redundancy,  and  low 
probability  of  occurrences.  Results  and  comments  were  used  as 
a guide  to  the  modification  of  the  events  for  Round  11.  (See 
Section  1.3.3  below). 

1.3.3  Round  II 


Round  II  was  the  second  Iteration  of  the  two  part  Expect  Panel  Review. 
The  refined  events  list  of  Round  I was  reviewed  as  follows; 

(a)  Modification  of  the  Round  I Events  List 

Based  cn  the  responses  of  the  Round  I participants,  thr»se  types 
of  modifications  were  made  In  the  events;  reduction  of  "abstracts" 
(changing  "all"  to  "most,"  for  example);  narrowing  of  scope 
(rewriting  one  event  as  two);  and  the  elimination  of  six  events 
which  were  seen  by  a majority  of  Round  I participants  as  both 
undesirable  and  unfeasible, 

(b)  Division  Into  Two  Events  Lists 

Round  II  was  to  be  conducted  with  two  separate  sets  of  partici- 
pants; a panel  of  experts  In  Information  technology,  and  a 
panel  of  Individuals  In  influential  information  science  positions. 
This  division  of  Round  II  was  designed  to  achieve  a high  level 
of  precision  In  the  Round  II  responses.  Each  panel  represented 
a specific  segment  of  expertise  and  the  events  were  divided  to 
eliminate  extraneous  opinions  from  panelists  in  areas  outside 
their  area  of  expertise.  Accordingly,  the  revised  events  were 
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converted  to  two  lists:  Round  lA,  events  concerning  Information 

technologies,  and  Round  IIB,  events  concerning  information 
issues.  Since  a Large  number  of  events  had  implications  for 
both  technology  and  issues,  they  were  included  op  both  lists. 

The  Round  IIA  and  IXB  Events  Lists  with  the  aggregate  data 
are  included  as  Appendices  B and  C,  respectively. 

(c)  Selection  of  Round  II  Participants 

The  Round  II  participants  were  chosen  to  represent  two  areas  of 
expertise  - technology  (panel  A)  and  planning  and  administration 
(panel  B) . Round  II  structure  was  weighted  to  favor  the  input 
from  the  planners  and  administrators  by  selecting  17  members  for 
panel  B versus  10  for  panel  A (In  the  analysis  the  aggregate 
data  were  averaged,  thus  the  17  panel  B responses  tended  to  ha-  i 
greater  influence  on  the  mean). 

It  was  expected  chat  Che  points  of  view  expressed  by  the  t'  o 
homogeneous  panels  would  be  divergent  when  examined  separately. 
This  assumption  proved  to  be  valid.  The  results  were  blended 
Co  moderate  any  extreme  opinions  (especially  negative  opinions) 
since  Che  experience  with  forecasting  studies  of  this  type  show 
chat  technological  progress  is  often  realized  sooner  than  the 
experts  predict.  Thus,  we  hope  these  results  will  accurately 
represent  the  future  path  of  information  technology  advancement. 
This  part  of  the  methodology  was  applied  only  to  those  events 
which  had  implications  in  technology  as  well  as  in  organizational, 
economic  and  service  aspects  of  information  science. 

Events  that  were  purely  related  to  technology  or  purely  related 
to  planning  and  administration  Issues  were  submitted  only  to 
the  respective  experts  in  these  areas.  This  was  done  to  avoid 
collecting  spurious  data  provided  by  panelists  beyond  their  area 
of  expertise.  (Appendices  A,  B,  and  C indicate  the  events 
submitted  to  each  panel.) 

The  ten  Round  IIA  participants  (technology  experts)  were  selected 
from  the  staff  of  the  AUERBACH  Corporation  (excluding  the  DDC 
study  project  team).  All  are  senior  personnel  with  special 
expertise  in  the  fields  of  computers,  micrographics,  teleprocess-' 
ing,  or  information  systems  design.  Panel  IIB  consisted  of  17 
individuals  in  influential  Information  science  positions  who  are 
concerned  with  long  range  planning  and  administration.  They 
represent  a cross  section  of  the  information  community.  Three 
were  affiliated  with  government  agencies,  seven  with  for-profit 
organizations,  and  seven  with  not-for-profit  Institutions. 
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d)  Solicitation  of  Responses  from  the  Round  IIA  Partlclpanta 

The  Round  IIA  Events  Lists  were  distributed  In  person  by 
a member  of  the  project  team  to  panelists  who  previously 
had  been  asked  to  participate.  The  purpose,  scope  and 
procedures  of  the  task  were  reviewed  at  the  outset  and  each 
panelist  was  permitted  one  week  to  respond.  (The  list 
required  about  1^  hours  to  complete).  The  events  were 
collected  at  the  end  of  the  week  and  panelists  were  debriefed 
on  their  experience  with  Round  IIA  review  Instrument. 

(e)  Solicitation  of  Responses  from  the  Round  IIB  Participants 

The  Round  IIB  panelists  (who  had  been  Invited  to  participate 
by  telephone  with  follow-up  letters  of  Invitation)  received 
their  copies  of  the  Events  Lists  at  an  Initial  group  meeting. 

At  that  meeting,  the  project  was  reviewed  and  the  purpose 
scope  and  procedures  for  the  review  were  outlined.  There  was 
no  group  discussion  of  the  events.  The  review  was  estimated 
to  be  approximately  a 1^  hour  effort.  Jompleted  events  lists 
were  to  be  returned  by  mall.  All  results  were  received 
within  two  weeks. 

(f ^ Analysis  of  Round  II  Responses 

Each  panelist's  responses  were  first  examined  to  see  if  there 
were  Inter-event  inferences  reflected  In  the  responses  - espec- 
ially the  comment  responses.  If  so,  they  were  noted  on  each 
Involved  event.  Then  the  events  were  physically  separated 
and  recombined  so  that  all  responses  to  a given  event  were 
merged.  The  aggregate  data  were  collected  and  the  totals  were 
used  to  calculate  the  values  for  each  event.  Importance  was 
measured  as  the  percentage  of  panelists  who  Indicated  an  event 
as  "important."  "Desirability"  and  feasibility  ratings  (assigned 
on  a scale  of  1 to  10)  were  averaged  for  each  event.  The 
"probable  timing"  dates  (l.e.,  forecasted  dates)  were  averaged, 
as  well.  The  data  were  analyzed  within  specific  areas  of  Interest, 
generally  categorized  under  four  main  areas'  - technology, 
organizational  structures,  economics  and  marketing  and  services. 
Hiey  were  also  analyzed  for  trends  reflected  In  the  comments  and 
by  Implication  of  the  relative  scores  of  Interrelated  events. 
Appendix  A consists  of  several  tables  compiled  to  aid  the  analysis 
with  cross  comparisons  between  and  among  the  events.  Appendices 
B and  C report  the  aggregate  data  from  Round  IIA  and  Round  IIB 
respectively. 

1.4  RELATIONSHIP  OF  THE  EXPERT  PANEL  REVIEW  TO  THE  STUDY  AS  A WHOLE 


The  Expert  Panel  Review  Is  but  one  of  four  major  facets  of  AUERBACH* s 
long  range  planning  study  for  DDC.  The  other  three  consist  of:  a User  Survey, 


an  Interagency  Survey,  and  an  Internal  Review  of  DDC  Plans  and  Operations.  The 
findings  of  all  four  facets  of  the  study  will  be  assessed  and  evaluated  separate- 
ly and  together  as  a final  report  Intended  to  be  a DDC  planning  document 
appropriate  for  the  user  needs,  technological  capability  and  Interorganlzatlon 
Information  structure  forecast  for  the  decade  1978  to  1988. 
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ORGANIZATION  OF  THE  REPORT 

The  remainder  of  this  report  is  divided  Into  the  following  sections: 


• Section  II: 

• Section  III: 

• Appendix  A: 

• Appendix  B: 

• Appendix  C: 

• Appendix  D: 

• Appendix  E: 


Discussion  of  Findings 
Conclusions  and  Interpretations 
Data  Tabulation 

Round  IIA  Aggregate  Data  with  Comments 
Round  IIB  Aggregate  Data  with  Comments 
Questions  and  Issues  Related  to  the  Events 
Events  Classified  by  Desirability/Feasibility 
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SFCTION  II.  DISCUSSION  OF  FINDINGS 


This  section  discusses  the  data  of  the  Expert  Panel  Review  task.  It 
consists  of: 

• A summary  of  the  Round  II  results*  which  Is  the  seccnd 
Iteration  of  the  two  part  Expert  Panel  Review  task. 

• A comparison  of  the  results  from  panel  IIA  (Technology 
experts)  and  panel  IIB  (Information  system  planners  and 
administrators) 

• A comparison  of  Round  II  results  with  the  Round  I panel 
(Information  system  practitioners  and  researchers) 

V 

For  the  purposes  of  this  report, the  following  definitions  apply: 


A.  Panel  Composition 

1.  Round  I Panel:  10  Individuals  with  expertise  at  the  sys- 

tems level,  such  as  practitioners  and  researchers  with 
expertise  In  various  phases  or  aspects  of  Information 
science  (e.g.,  program  managers  of  significant  information 
systems) . 

2.  Round  II 

a.  Panel  A;  10  technology  experts  In  the  fields  of 

computers,  micrographics,  teleprocessing  and  Informa- 
tion systems  design. 
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b.  Panel  B;  17  individuals  in  influential  information 
science  positions  who  are  concerned  with  long  range 
planning  and  administration. 

B.  Events  List  Data  Elements 

1.  Events;  tlgnif leant  future  occurrences  relevant  to  the 

Information  community 

2.  Importance;  whether  or  not  the  panel  regarded  an  event 
as  potentially  a major  occurrence  In  the  information 
science  field 

3.  Desirability;  a relative  assessment  of  the  need  for  a given 
event  within  the  information  community 

4.  Feasibility;  a relative  assessment  of  the  practicality  of 
a given  event  occurlng 

5.  Probability;  a relative  assessment  of  when  an  event  is 
likely  to  occur 

2.1  ROUND  II  FINDINGS 


The  Round  II  findings  represent  the  second  iteration  of  the  two-part 
Expert  Panel  Review.  The  data  are  compiled  in  detailed  tables  in  Appendices  A, 
B,  and  C.  The  main  features  of  the  findings  are  presented  in  this  section. 

Section  III  discusses  the  time  phased  implications  of  the  findings, 
which  take  into  account  the  combined  factors  of  importance,  desirability, 
feasibility,  and  probable  timing. 

Round  II  data  were  collected  for  thirty-eight  events  representing 
four  areas: 

e Technology 

s Organizational  Structures 
e Economics  and  Marketing 
e Services 

Each  event  was  considered  for  importance,  desirability,  feasibility, 
and  probable  timing.  The  data  for  each  event  were  averaged  to  give  a composite 
racing  that  was  used  for  the  overall  analysis  in  comparing  events  against  each 
other. 
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2.1.1 


Importance 


Participants  were  asked  to  designate  events  that  they  believed  to 
be  "major  events."  This  was  done  to  Impart  an  order  of  significance  to  the 
various  events.  Results  were  tabulated  as  straight  percentages  of  respondents 
who  designated  an  event  as  "major."  Events  accorded  the  highest  ratings 
(top  207.)  were  (In  order  of  scores,  high  to  low): 

• Interactive  access  to  full  text  data  bases  replacing 
abstracts  and  Indexes  as  searching  tools 

• Researchers  have  access  to  data  bases  of  factual  verified 
data 

• Acceptable  machine  generated  Indexes 

• Paper  will  be  replaced  as  the  primary  numeric  storage 
medium  by  digital  media 

• Paper  replaced  as  numeric  dissemination  medium  by  digital 
media 

• Accessibility  of  many  data  bases  through  a single  terminal 

• Standardized  citation  formats 

e Interactive  access  to  citation  data  bases  replacing  abstracts 
and  Indexes  as  searching  tools 

e Information  synthesis  and  analysis  available  to  all  researchers 

• Optical  character  recognition  (OCR)  able  to  convert  any  docu- 
ment to  machine  readable  form 

e Machine  readable  storage  media  competitive  with  paper 

Events  accorded  the  lowest  ratings  (lowest  207.)  were  (In  order 

of  scores,  high  to  low): 

e Two  tiers  of  Information  providers  will  emerge  and  be  clearly 
definable:  "wholesalers"  and  "retailers" 

e Minicomputers  coupled  with  perpherals  will  generally  take  over  many 
functions  currently  performed  by  large  centralized  computers 

e Major  IS&R  systems  will  permit  a choice  of  output  format 


• Input  of  Information  to  large  IS&R  systems  (e.g.,  DDC,  NTIS, 
NASA,  etc.)  will  be  decentralized,  with  standardized  abstract" 
ing,  indexing  and  data  conversion  provided  at  the  local  source 
level 

• Federal  technical  information  services  becoming  self-support- 
ing 

s Dissemination  of  full  text  of  documents  precluding  the  need  for 
abstracts  as  announcement  devices 

• Automatic  monitoring  built  into  retrieval  systems 

• Paper  replaced  as  document  dissemination  medium  by  microform 

• Computers  designed  specifically  for  bibliographic  storage 
and  retrieval 


These  results  indicate  a select  set  of  "important"  trends  and/or 
technological  events: 


• Scientific  bibliographic  information  systems  are  following 

a trend  that  will  eventually  (some  undetermined  date  beyond  1988) 
result  in  a comprehensive,  international,  cross  disciplinary 
and  integrated  data  resource  that  will  be  accessible  to  individuals 
through  single  access  points 

• The  highest  payoff  area  for  increased  scientific  and  technical 
information  service  is  factual  data  services  that  are  non - 
bibliographic 

• Information  analysis  services  will  be  an  increasingly  important 
component  of  total  technical  Information  systems 

• The  application  of  electronic  devices  to  the  control  and  manipulation 
of  information  and  data  la  a dominant  trend.  The  particular  de- 
vices themselves  are  basically  of  Incidental  Importance.  It  Is 

the  applications  techniques  for  Information  handling  that  facilitate 
total  electronic  control  of  technical  Information  processes  that 
are  among  the  most  Important  matters  to  be  resolved. 


2.1,2  Desirability  and  Feasibility 

Respondents  were  asked  to  rate  the  desirability  and  feasibility  for 
each  event  on  a scale  of  1 to  10.  The  aggregrate  scores  of  panel  A and  panel  B 
were  averaged  for  each  event.  Desirability  and  feasibility  averages  were  used 
to  group  events  by  class  ("most"  > 7,5,  "moderate"  5-7.5,  "least"  < 5), 


The  results  have  been  tabulated  In  Appendix  E which  lists  eight  groups  from 
the  "Most  Desirable,  Most  Feasible"  events  to  the  "Least  Desirable,  Least 
Feasible"  events.  Each  group  Is  subdivided  by  Technology,  Organizational 
Affiliations,  Economics  and  Services.  Some  events  appear  on  the  tables  more 
than  once,  as  they  Impact  on  more  than  one  area. 

2.1.3  Probable  Timing  of  Round  II  Events 

Participants  were  asked  to  project  three  dates  for  each  event:  a 

date  of  20%  probability  of  occurrence,  a date  of  50%  probability,  and  a date  of 
90%  probability.  As  a relative  indicator,  the  50%  probability  averages  give  a 
fairly  consistent  picture,  and  as  such  they  are  used  here  as  an  index  of  probable 
timing.  Actual  forecast  dates  are  provided  in  Appendix  A. 

The  events  considered  likely  to  occur  soonest  (by  1985)  by  the  Round  II 
Panel  (Technology  Experts)  were  the  following  (average  50%  probability  dates 
in  parentheses): 

• IVo  tiers  of  information  providers:  "wholesalers"  and 

"retailers"  (1980) 

• Automatic  retrieval  systems  with  built-in  monitoring 
features  (1981) 

• Standardized  citation  formats  for  report  literature  (1982) 

• Standardized  abstract  formats  for  report  literature  (1982) 

• Duplication  in  acquisition  among  data  bases  will  be 
eliminated  (1983) 

• Minicomputers  coupled  with  peripherals  will  take  over 
mapy  functions  (1983) 

• Personal  interactive  terminals  will  be  available  for 

less  than  $500  (1983) 

The  events  judged  to  take  place  in  the  most  remote  future  (beyond 
1995)  were: 


0 Paper  will  be  replaced  as  document  storage  medium  by  full 
text  digital  media  (1997) 

§ Access  to  full' text  data  bases  will  replace  abstracting  and 
indexing  as  searching  tools  (1997) 
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• Standardization  will  allow  data  bases  to  be  merged  into 
a single  file  (2000+) 

• Paper  will  be  replaced  as  document  dissemination  medium 
by  full  text  digital  media  (2000+) 

The  remaining  events  were  all  Judged  to  have  a 50%  possibility 
of  occurring  between  the  mid  1980' s and  the  1990' s. 

Actual  estimated  dates  for  events  are  shown  in  Appendix  A and 
Appendix  B together  with  the  completed  results  of  the  "A"  Event  List  and 
the  "B"  Event  List. 

2.2  COMPARISON  BETWEEN  ROUND  IIA  AND  ROUND  HB 


Of  the  38  events  considered  in  Round  II,  20  events  (representing 
26  possibilities)  were  submitted  to  both  the  "A"  panel  (Information  technology 
experts)  and  the  "B"  panel  (planners  and  administrators).^  Seven  events 
appear  only  on  the  "A"  list  and  eleven  appeared  only  on  the  "B"  list. 

Appendix  A indicates  the  events  submitted  to  each  group. 

2.2.1  Importance 

The  Round  IIB  panel  (administrators  and  planners)  tended  to  ascribe 
"importance"  to  more  events  than  the  Round  IIA  panel  (technologists).  Specifically, 
of  the  26  events,  analyzed  for  both  lists,  16  rated  higher  in  importance  in 
Round  IIB  than  in  Round  IIA,  eight  rated  higher  in  Round  IIA  and  two  were  rated 
equal  in  importance  in  both  groups. 

These  data  are  not  surprising.  It  was  anticipated  that  the  "Importance" 
of  the  events  would  be  assessed  in  terms  of  the  benefits  that  would  be  inferred 
from  theii'  coming  to  be.  Of  the  two  panels  in  Round  II,  the  planners  and 
administrators  of  large  information  systems  (the  Round  IIB  panel)  are  apt  to  be 
more  comfortable  with  anticipating  the  potential  benefits  of  new  technological 
developments.  Therefore,  they  saw  more  events  as  "important." 


Two  of  the  events  common  to  both  lists  had  four  parts  each.  For  purposes 
of  analysis,  the  parts  were  treated  as  separate  events,  bringing  the  number 
of  common  events  to  26, 
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The  technology  itself  appears  to  lack  Importance  In  the  Judgement 
of  the  Round  II  panels  without  the  Inference  of  useful  applications. 

Despite  the  fact  that  the  importance  ratings  of  the  B panel  were 
higher  than  the  A panel,  both  groups  ascribed  a fairly  consistent  ordinal 
ranking  to  the  events,  which  produced  the  composite  results  discussed  In 
Section  2.1.1. 

Events  on  which  the  importance  assessments  of  the  two  panels  con- 
trasted strikingly  were  few. 

Only  one  event  was  highlighted  by  the  Round  IIA  panel  alone: 

• Paper  replaced  as  a document  dissemination  medium  by  microform 
Events  highlighted  by  the  Round  IIB  panel  alone  included: 

• Machine  readable  storage  media  competitive  with  paper 

s Machine  readable  files  transferred  electronically,  competitive 
with  postal  service 

Majority  of  remote  retrieval  done  via  dial-up  lines 

• Facsimile  transmission  competitive  with  postal  service  in 
cost 

2.2.2  Desirabilijy 

Opinions  varied  widely  among  all  participants  of  both  groups  as  to 
the  desirability  of  individual  eventr.  However,  a similar  pattern  was  exhibited 
as  that  seen  for  the  "liopoitance*'  designation.  Of  26  events  analyzed,  15  rated 
higher  in  desirabiliLy  in  Round  IIB  than  in  Round  IIA,  seven  rated  higher  in 
desirability  in  Round  IIA  than  in  Round  IIB,  and  four  were  Judged  about  equal. 

The  events  considered  more  desirable  in  panel  A than  by  panel  B 

were: 


• Paper  replaced  as  numeric  dissemination  medium  by  microform 

• Paper  replaced  as  document  dissemination  medium  by  microform 
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• Use  of  commercially  available  software  replacing  all  original 
software  development 


The  events  seen  as  considerably  more  desirable  by  panel  B than 
by  panel  k were: 

a Numeric  data  processing  will  equal  bibliographic  data 
processing 

• Many  data  bases  accessible  through  a single  on-line  terminal 

• Automatic  retrieval  systems  with  built-in  monitoring  features 

e Personal  interactive  terminals  as  common  as  automatic  typewriters 

2.2.3  Feasibility 


In  feasibility,  panel  B again  tended  to  rank  events  higher  than  panel  B. 
Of  the  twenty  six  events,  thirteen  were  rated  higher  in  feasibility  by  panel  B 
than  the  panel  A,  eight  were  rated  higher  in  feasibility  in  the  panel  A than 
panel  B,  and  five  were  rated  about  equal  in  feasibility  by  both  groups. 

Events  seen  as  considerably  more  feasible  by  Group  A than  by  Group  B 


were : 

e Machine  readable  storage  media  for  text  competitive  with 
microfilm 

• Machine  generated  index  data  virtually  eliminating  manual 
indexing 

a Commercially  available  software  virtually  replacing  original 
software  development 

a Standardized  user  protocols  adopted  by  all  technical 
information  services 

a Conversational  and  tutorial  on-line  capabilities  will  make 
intermediaries  unnecessary 


Events  seen  as  considerably  more  feasible  by  panel  B chan  panel  A 


were: 


a Machine  readable  records  electronically  transferred  between 
locations  at  low  cost 

• Personal  interactive  terminals  common 

a Paper  virtually  replaced  as  document  dissemination  medium  by 
microform 
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• Inforaatlon  systems  allowing  user  to  specify  output 
format 

• Researchers  having  access  to  data  bases  of  validated  numeric 

data 

2.2.4  Probable  Timing 

The  Round  llA  panel  and  the  Round  IIB  panel  were  relatively  consistent 
In  their  forecasts  of  timing.  The  average  forecast  ranges  of  each  panel»  for 
each  event,  tended  to  overlap  with  the  average  data  points  for  20%  probability, 
50%  probability  and  90%  probability  falling  within  5 years  of  each  other.  The 
Round  IIB  panel  (planners  and  administrators)  tended  to  be  somewhat  more 
optimistic  than  the  Round  IIA  panel  (technology  experts).  Ten  of  the  26  compar- 
able events  were  forecast  to  occur  sooner  by  panel  B.  Only  four  events  were 
forecast  to  have  a more  proximate  probability  of  occurance  by  panel  A than  by 
panel  B.  Twelve  were  forecast  approximately  even  by  both  groups. 

Notable  differences  (more  than  10  years)  In  the  50%  probability 
forecasts  of  the  two  panels  are  these: 

• Events  Judged  to  be  more  proximate  by  panel  A were: 

- Machine  readable  storage  competitive  with  paper 
(panel  A - 1985;  panel  B - 1996) 

- Standardisation  allowing  data  bases  to  be  merged  Into 

a single  file  by  user  organisations  (panel  A - 1993;  panel 
B - 2080) 

• Events  judged  to  be  more  proximate  by  panel  B were: 

- Personal  Interactive  terminals  connon  (panel  A - 2002; 
panel  B - 1985) 

- Paper  replaced  as  a document  dissemination  medium  by 
microform  (panel  A - 1996;  panel  B - 1984) 

- Researchers  having  access  to  data  bases  of  validated 
numeric  data  (panel  A - 2003;  panel  B - 1989) 

2 . 3 COMPARISON  BETWEEN  ROUND  I AND  ROUND  II 


Since  many  events  were  rewritten  following  Round  i,  and  some  were 
eliminated,  exact  comparisons  of  results  between  Round  I and  Round  II  are  not 
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possible.  However,  a rough  comparison  could  be  made  between  similar  events. 

The  "Importance"  parameter  was  not  measured  In  Round  I,  thus  comparison  was 
made  In  terms  of  desirability,  feasibility,  and  probable  timing, 

2.3.1  Desirability  and  Feasibility 

Of  the  thlrty>«lx  eeparate  events  were  eimllar  enough  between  Round  I and 
II  to  be  compared,  12  were  Judged  equally  desirable  and  feasible  by  Round  I 
and  II,  18  were  Judged  generally  more  desirable  and  feasible  by  Round  I than 
Round  II,  and  six  were  Judged  more  generally  desirable  and  feasible  by  Round 
II  than  Round  I,  However,  the  divergence  was  not  extreme  except  In  the  cases 
of  the  following  events: 

e User  organisations  able  to  merge  data  bases  Into  a single  file 

e Researchers  having  option  of  data  analyses  services  through 
an  information  analysis  center 

Both  events  were  Judged  most  desirable  and  feasible  by  Round  I, 
but  only  moderately  desirable  and  least  feasible  by  Round  II. 

2.3.2  Probable  Timing 

In  estimates  of  probably  timing.  Round  I and  Round  II  panels  were  In 
high  agreement.  For  20  of  the  36  comparable  events  the  50%  probability  forecast 
of  Round  I and  Round  II  were  within  5 years  of  each  other.  Of  the  10  events 
where  the  results  differed  by  more  than  5 years,  6 were  Judged  to  be  more 
proximate  by  Round  II.  However,  the  different  estimates  were  considered  sig> 
nif leant  (more  than  10  years)  for  only  four  events: 

e User  organisations  able  to  merge  data  bases  Into  a single  file 
(Round  I;  1983;  Round  II  « 2000+) 

• Researchers  having  option  of  data  analysis  services  through 
an  Information  analysis  center 
(Round  1:  2000+;  Round  II:  1991) 

e Processing  of  numeric  data  equalling  bibliographic  data 
(Round  I:  2000+;  Round  II;  1984) 

e Researchers  having  access  to  data  bases  of  verified  numeric 
data 

(Round  I;  1996;  Round  II:  1986) 
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SECTION  III.  CONaUSIONS  A^^)  INTERPRETATIONS 


The  Expert  Panel  Review  Task  was  prestructured  to  highlight  gaps  In 
Information  services  and  products  resulting  from  Inadequacies  and  unresolved 
problems  In  Information  technology,  organizational  structures  and  economic  and 
marketing  factors.  This  section  auamarlees  the  probable  effects  that  the  fore- 
casted state-of-the-art  will  have  on  major  Information  processing  operations  and 
plans.  Specific  DDC  Implications  are  pointed  out  as  appropriate. 

The  Interrelationships  among  events  are  presented  first  as  a summary  by 
area  - technology,  organizational  structures,  economics  and  marketing, and  services 
and  second,  as  time-phased  goals  Implied  by  supporting  events. 

These  conclusions  and  goals  are  structured  to  provide  a graphic 
representation  of  realistic  expectations  of  technological  advances  that  will 
serve  to  guide  DDC's  time  phased  planning  to  achieve  new  and  expanded  user 
services  In  the  decade  1978  to  1988  (and  beyond).  Three  time  phases  are  referred 
to  In  the  text:  short  range  - before  1985,  mid  range  - 1985  to  1995,  long 

range  - beyond  1995. 

To  sum  up  the  results  of  the  Expert  Panel  Review  Task  succinctly,  the 
gaps  In  Information  services  and  products  are  not  In  hardware  technology  but  In 
the  application  of  technology  to  user  needs.  For  example,  non-blbllographlc, 
fact  retrieval  services  are  Identified  as  an  Important  service  gap.  The  forecast 
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indicates  that  advances  in  input  techniques,  conmunicationa  (in  the  broadest  sense)  and 
standardized  (or  common)  procedures  that  reduce  needless  duplication  and  errors 
of  logic  or  syntax  will  contribute  to  Improving  information  services.  However, 
advances  are  not  likely  to  be  dramatic. 

3.1  TECHNOLOGY 


3.1.1  Computer  Hardware 

Large  scale,  general  purpose  computers  will  continue  to  be  utilized 
for  bibliographic  as  well  as  other  types  of  storage  and  retrieval  in  the  next 
decade.  It  appears  quite  unlikely  as  well  as  basically  unnecessary,  that  computer 
systems  will  be  designed  specifically  for  bibliographic  applications. 

Patterns  are  evident  that  indicate  complete  electronic  control  over 
information  processing  operations  is  desirable.  The  feasibility  of  complete  con- 
trol is  questioned,  but  partial  control  over  sub-functions  is  increasingly  going 
to  involve  automation.  The  probability  that  technological  growth  will  be 
piecemeal  implies  that  systems  will  soon  enter  a development  phase  favoring 
decentralization  and  distributed  processing. 

Already  emerging  are  new  applications  In  peripherals  which  may  be 
especially  adapted  for  bibliographic  and  full  text  processing,  notably  optical 
character  recognition  Input  devices  (OCR)  and  word  processing  equipment.  Word 
processing  Is  seen  as  a development  particularly  worth  watching,  since  the  product 
Is  then  put  Into  machine  readable  form  at  Its  source.  OCR,  by  contrast.  Is  an 
after-the-fact  procedure  of  converting  text  to  machine-readable  forms.  It  Is 
unlikely,  however,  that  either  process  will  be  really  widespread  before  the  late 
1980's,  due  to  human  engineering  problems.  Incompatible  equipment  produced  by 
different  manufacturers,  lack  of  standardization,  unwillingness  of  potential 
buyers  to  comnit  funds,  and  general  unsureness  of  how  exactly  to  use  such 
equipment  most  effectively  were  It  to  be  acquired.  Automatic  text  Input  devices 
are  seen  as  potentially  desirable  and  only  slightly  ahead  of  the  current  state- 
of-the-art. 

Another  potential  and  quite  controversial  development  In  peripherals 
Is  the  Inexpensive  "personal"  Interactive  computer  terminal.  Many  experts  see 
this  as  unnecessary  and  a burden  on  any  researcher  who  must  so  cope  without  an 
Intermediary  to  do  his  Information  searches  for  him.  Other  information  pro- 
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fesslonals  foresee  favorable  effects  including  possibilities  for  teleconferencing. 
Whether  or  not  the  "personal"  terminal  becomes  a reality,  however,  interactive 
terminals  will  proliferate  and  be  more  available  to  all  researchers  in  the  next 
decade.  Interactive  terminals  and  other  types  of  peripherals  may  also  be  coupled 
with  minicomputers  (and  eventually,  micro  computers)  for  applications  such  as 
data  manipulation,  intermeJ.'ate  data  processing,  and  local  data  control, 

A number  of  new  computer  memory  technologies  are  being  developed 
(holographic,  "bubble,"  etc.)  but  are  unlikely  to  affect  standard  data  processing 
techniques  for  quite  some  time.  Associative  memories,  however,  (a  very  fast 
parallel-processing  type  of  memory)  are  likely  to  be  of  some  auxiliary  use  in 
Information  processing  by  the  early  1990's.  These  memories,  too  expensive  to 
consider  for  bulk  storage,  have  a useful  potential  as  hardware  support  for  software 
"macro"  instructions  and  for  index  table  processing  in  information  retrieval  pro- 
cedures. 

3.1.2  Computer  Software 

In  software,  machine  independence  is  seen  as  a useful  trend.  However, 
it  is  regarded  as  a mid-range  achievement,  delayed  into  the  1990* s by  inherent 
inefficiencies  of  machine  independent  software. 

Purchasing  software  packages  is  seen  as  a desirable  alternative  to 
de  novo  programming.  Packages  with  monitoring  and  tutorial  features  for  on-line 
interactive  systems  can  be  available  in  the  short  range.  The  development  of 
useful,  commercial  packages  Is  regarded  as  feasible  if  DDC  or  similar  influential 
agencies  could  define  the  requirements  in  their  area  and  thus  offer  an  incentive 
to  potential  vendors  to  develop  such  packages.  The  importance  of  on-line 
tutorial  assistance  is  linked  to  the  growth  of  personal  interactive  search  ser- 
vices. 

3.1.3  Communications 


Total  electronic  point-to-point  communication  is  seen  as  highly  desirable. 
For  example,  the  highest  ranked  event  in  importance  was  "interactive  s :cess  to  full 
text  data  bases  replacing  abstracts  and  Indexes  as  searching  tools."  Supporting 
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events  leading  toward  that  all  encompassing,  long-range  event  show  a set  of  short 
and  mid  range  achievements  Including  widespread  availability  of  personal  terminals, 
dial-up  communication  systems,  electronic  file  transfer  at  reasonable  cost 
and  facsimile  transmission  of  supporting  material.  In  all  casee^  microform  communica- 
tion and  paper  were  seen  as  limited  use, Interim  communication  media.  It  Is 
probable  that  In  the  long-range,  microforms  will  be  virtually  replaced  by  digital 
media  with  paper  fulfilling  a basic  function  unsulted  to  any  medium  other  than 
paper.  (For  example,  work  In  progress  records) 

3.1.4  Information  Storage  and  Dissemination  Media 

Microform  will  be  the  prime  storage  medium  for  large  bibliographic 
files  for  at  least  the  next  decade.  Beginning  In  the  1980' s,  machine  readable 
digital  storage  will  begin  to  be  competitive  on  a cost  basis  with  paper  and 
microform.  Gradually,  digital,  machine  readable  file  storage  will  replace  present 
day  file  techniques.  The  probable  sequence  will  be  numeric  data  files  first,  then 
bibliographic  surrogate  files  (Indexes  before  abstracts)  and  ultimately  full 
text  files.  However,  the  opinion  of  the  members  of  the  panel  Is  that 
no  media  will  ever  completely  replace  or  be  more  acceptable  than  paper.  Therefore, 
DDC  should  always  consider  ways  that  permit  Individuals  to  select  or  regenerate 
paper  copy  from  bibliographic  system  output  files. 

3.2  ORGANIZATIONAL  STRUCTURES  AND  AFFILUTIONS 


The  Expert  Panel  Review  task  emphasized  technology  and  services.  Thus, 
only  two  organizational  Issues  were  .<iubmltted  to  panel  reviews  - standardization, 
and  whether  DDC  should  be  acting  as  a "wholesaler"  of  Information  or  a "retailer" 
(dealing  directly  with  users). 

Standardization  events  are  regarded  among  the  most  Important.  Standardiza- 
tion Is  regarded  as  most  desirable  and  feasible  with  standardization  of  citation 
data  somewhat  more  feasible  than  standardization  of  abstracts.  However,  there  Is 
a counter- Influence  Indicated  In  several  events  that  indicate  a preference  for 
Independent  operations.  For  example,,  standardized  vocabularies  and  merged  data 
bases  are  regarded  as  relatively  unimportant  and  only  moderately  desirable. 
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Conaequently,  standardization  should  not  be  viewed  as  part  of  a move  toward 
coalescence  and  some  form  of  a consolidated  national  system  but  rather  as  a 
matter  of  common  Interest  to  facilitate  Interagency  communication  and  Informa- 
tion exchange. 

Similarly,  Information  processing  organizations  acting  exclusively  as 
"wholesalers"  or  "retailers"  Is  an  unlikely  and  undesirable  event.  Technological 
and  applications  gaps  will  prevent  adequate  direct  service  to  users  being  pro- 
vided exclusively  from  remote,  central  Information  resources.  Thus,  for  the 
foreseeable  future,  large  processors,  such  as  DDC,  must  function  with  a structure 
that  permits  and  encourages  smaller  or  more  specialized  Information  agencies 
to  deal  directly  with  users  even  If  the  central  agency  elects  to. provide' some 
"retail"  services  directly  to  users. 

Frequent  and  Intensified  cooperative  efforts  are  forecast  as  desirable 
and  feasible,  particularly  among  agencies  with  complementary  capabilities.  For 
example,  DDC's  cooperative  efforts  with  NASA  and  Its  plans  to  utilize  the 
ARPANET  to  broaden  Its  service  range  were  cited  as  favorable  developments. 

On  the  questions  Involving  Interaction  of  data  bases,  the  character 
of  "Independence  with  cooperation"  was  seen.  Feasible  events  point  toward 
developing  algorithms  and  methodologies  for  translating  between  different  data 
formats,  thus  ensuring  a workable  measure  of  compatibility  without  rigid  Inter- 
agency standardization. 

3.3  ECONOMICS 

3.3.1  Costs 

Cost  factors  are  not  Inherent  barriers  to  advancing  Information  tech- 
nology. Notably,  no  event  directed  at  cost  Issues  was  rated  among  the  top  20% 
In  Importance  regardless  of  the  level  of  desirability  and/or  feasibility. 
Naturally,  downward  cost  trends  were  regarded  as  desirable.  In  fact,  downward 
costs  are  forecasted  because  of  Increased  production  and  more  widespread  use  of 
digital  technologies  which  will  result  In  lower  costs  per  unit  for  hardware  and 
software  (In  terms  of  current  dollars).  Coimnunlcatlons  costs  will  also  drop, 
although  not  Indefinitely. 
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Beyond  the  data  of  the  Expert  Panel  Review,  conjecture  suggests 
that  lower  costs  and  more  efficient  hardware  are  Insufficient  and  possibly 
lnappropria*.d  objectives  as  such  for  the  information  community.  Despite  success 
after  success  in  hardware,  and  to  a lesser  extent  software  (much  of  which  is 
a direct  result  of  Government  underwriting  of  development  costs),  the  essential 
problems  of  intellectual  information  transfer  are  identified  as  the  "important" 
gaps  in  information  technology.  System  design  problems  Involving  machine “machine 
interface,  man-machine  interface  and  interorganizational  interaction  are  consistently 
highlighted  in  the  Expert  Panel  Review  rounds. 

From  past  experience,  represented  in  the  opinions  of  the  panel  members, 
quantum  improvements  in  information  processing  technology  will  not  result  from 
more  automation  alone.  More  sophisticated,  total,  and  human- sensitive  design 
concepts  are  required  than  have  been  employed  to  date. 

Given  these  conjectural  circumstances,  priorities  for  R & D funding 
ought  to  emphasize  projects  directed  toward  more  effective  utilization  of 
state-of-the-art  technology  over  developing  new  capabilities  of  hardware  and 
software.  Particularly,  funding  should  be  directed  toward  research,  design 
and  testing  of  new  and  more  effective  interactive  technologies  involving 
machine-machine  interface,  man-machine  interface  and  organization-organization 
interface . 

3.3.2  Source  of  Funding  for  Information  Services 

That  federal  technical  information  services  become  self-supporting 
is  regarded  as  undesirable  and  unfeasible.  Both  R & D funding  and  operating 
costs  are  likely  to  require  at  least  partial  subsidy.  The  perception  of  a 
relationship  between  information  services  and  accrued  benefits  is  at  best 
tenuous.  Thus,  efforts  to  achieve  total  cost  recovery  are  likely  to  retard 
experimentation  with  new  concepts  and  services  at  a time  when  such  experimenta- 
tion is  seen  as  essential  to  real  progress  in  information  processing  technology. 

3.4  SERVICES 


Events  directed  toward  identifying  conceptual  gaps  in  the  nature  of 
information  services  received  the  highest  ratings  in  importance  (first  and 
second).  However,  it  is  disappointing  (as  well  as  enlightening)  that  the  panels 
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were  very  pessimistic  about  the  prospects  for  bridging  the  gaps  before  1995. 

Three  conclusions  stand  out; 

• Access  to  complete  information  is  needed  (surrogates  are  only 
useful  intermediate  tools) 

• Services  have  to  be  interactive 

• Researchers  need  acress  to  factual,  verified  data 

3.4.1  Accessibility  to  Information  Resources 

Panelists  in  each  of  the  Rounds  stressed  the  need  for  users  to  have 
access  to  comprehensive  information.  It  is  desirable  and  feasible  that  the  logi- 
cal strategy  to  accessing  comprehensive  information  stores  appear  direct  and 
"simple"  to  the  user.  While  many  events  imply  that  in  the  long  range,  total 
electronic  control  and  manipulation  of  information  processes  will  provide  the 
means  for  accomplishing  widespread  comprehensive  accessibility,  it  is  forecast 
that  to  maintain  the  appearance  of  simplicity,  human  intermediaries  will  be  most 
desirable  for  the  short  and  mid  range  periods.  The  human  intermediary  is  seen 
as  essential  . He  may  be  an  information  specialist  or  an  R & D user  sophisticated 
in  information  processes  who  will  be  able  to  translate  man-machine  communication 
and  act  as  a logical  connecting  node  in  an  accessible,  but  complicated  technical 
information  community  which  will  persist  into  the  1990's. 

The  ability  to  address  the  complete  technical  information  record 
(i.e.,  all  possible  technical  information  files)  w ts  regarded  as  only  one 
aspect  of  ensuring  accessibility  to  Information  resources.  Equally  important 
is  the  ability  to  pursue  an  interactive  search  strategy.  Broad  accessibility 
is  implied  by  comprehensive  addressibility.  Precise  accessibility  is  provided 
by  iteration.  Thus,  an  interactive  type  of  information  system  is  the  most 
preferred  mode  of  operation.  Interaction  can  exist  at  several  levels.  It 
usually  is  taken  to  refer  to  the  ability  of  a terminal  user  to  address  and 
define  succeeding  subsets  of  a master  file  in  a dialog  type  of  interaction. 

More  sophisticated  interaction  can  involve  machine- to-machlne  interaction  and 
inter-file  interaction  (e.g.,  use  of  multiple  files  accessed  in  a number  of 
Independent  locations)  on  an  ad  hoc  basis. 


In  the  long  term,  both  broad  and  deep  accessibility  should  be  pro- 
vided in  order  to  provide  the  full  scope  of  services  required  by  technical 
Information  users. 

3,4.2  Fact  Services 


The  most  conspicuous  gap  in  information  services,  according  to  the 
Expert  Panel  Review,  is  fact  Information.  Fact  information  includes  numeric 
values  and  also  pieces  of  discrete  data  capable  of  satisfying  inquiries  without 
further  reference.  The  technology  is  estimated  to  be  capable  of  supporting 
such  a service  and  it  is  rated  most  desirable  and  extremely  Important.  Yet, 
the  probable  timing  places  this  as  a mid  to  long  range  event. 

This  event  must  be  regarded  as  a high-payoff  area  for  DDC  to  pursue. 

There  appears  to  be  no  explanation  for  the  lack  of  progress  in  fact  services 
other  than  neglect  on  the  part  of  the  information  planners  and  designers. 

3.4.3  Information  Analysis 

Information  analysis,  like  fact  retrieval, is  an  extension  of  Information 
services  that  goes  beyond  citations  and  document  retrieval.  This,  too,  is  an 
event  that  was  regarded  by  the  panels  to  be  "important".  However,  it  is  interest- 
ing that  it  was  considered  to  be  only  "moderately  desirable"  and  "least  feasible" 
as  a service  for  "all  researchers."  It  appears  that  information  analysis  is  a 
service  to  be  offered  Judiciously. 

Alternative  interpretations  inferred  from  these  results  suggest  two 
DDC  options.  DDC  can  build  Oii  its  present  referral  service  and  become  a centralized 
referral  center  for  information  analysis.  This  option  requires  that  DDC  be 
able  to  provide  expert  consultation  on  the  various  capabilities  of  information 
analysis  centers.  Computerized  listings  of  selected  names  of  centers  meeting 
search  parameter- • is  not  sufficient.  Users  need  Interactive  dialog  to  be 
able  to  assess  the  appropriateness  of  various  information  centers  for  their 
needs  of  a given  moment. 

A second  alternative  is  for  DDC  to  sponsor  or  establish  and  maintain 
an  information  analysis  center  covering  subjects  of  general  interest  or  multi- 
disciplinary fields  not  adequately  provided  for  by  the  specialized  information 
analysis  centers  currently  sponsored  by  DoD. 
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TIME-PHASED  GOALS  AND  SUPPORTING  EVENTS 


A key  objective  of  the  Expert  Panel  Review  was  to  develop  a time 
phased  structure  to  the  forecasted  technological  advancement  of  Information 
processing.  This  section  takes  the  findings  and  conclusions  previously  dis- 
cussed and  adds  a sense  of  prioritization. 

The  two  parts  of  this  section  present  the  events  of  the  Expert  Panel 
Review  In  terms  of  prioritization  by  relative  Importance  and  prioritization  by 
time  phased  goals. 

3.^.1  Prioritization  by  Order  of  Importance 

The  Expert  Panel  Review  task  resulted  in  a well  distributed  order  of 
importance  to  the  events  submitted  for  review.  Figure  3-1  Illustrates  the 
distribution  of  events  according  to  the  "importance*'  rating  ascribed  by  the 
Round  II  panel.  15  events  were  Judged  "importantV  by  607.  of  the  panel,  9 events 
by  707.  of  the  panel  and  one  event  each  by  807.  and  907.  of  the  panel,  respectively. 


Percentile  Indicated  "Important" 

Figure  3-1.  Distribution  of  Events  by  Importance 

Eleven  events  in  the  70  to  90  percentile  made  up  the  top  207.  of 
events  by  importance.  They  also  represented  the  down  slope  on  the  distribution 
curve  (i.e.,  the  above  average  "important"  events).  Thus,  these  11  events, 
shown  in  Figure  3-2, were  chosen  as  a select  set,  which  were  interpreted  to  be 
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Most  Important  Events 


Flg'ire  3-2-  (Continued) 


L. 


the  appropriate  events  to  govern  the  direction  of  information  technology  that 
would  be  most  likely  to  result  in  quantum  Improvements  in  information  processing 
technology. 

The  events  are  evenly  distributed  between  technology  and  aervlcea  with 
standardization  achievement  acting  as  a sort  of  bridge.  Achievements  of  cost 
related  events  are  notably  lacking  in  the  list  of  "important"  events. 

3,5.2  Tlme^Phased  Goals  and  Supporting  Events 

Using  the  most  important  events  (top  20%X  four  principal  time  phased 
goals  are  recommended  that  should  characterize  DDC's  long  range  planning. 

• Achieve  complete  electronic  control  over  Information  processes 

• Provide  a comprehensive  International  cross  disciplinary  and 
integrated  data  resource  that  will  be  accessible  to  individuals 
through  single  access  points 

• Provide  non-bibliographic  services 

• Provide  information  analysis  services 

These  goals  and  their  supporting  events  are  shown  in  Figure  3-3. 

The  order  shown  is  by  probable  timing.  As  can  be  seen  in  the  graphic  representa- 
tion, there  is  a wide  range  forecasted  for  some  events.  But  the  50%  probable 
timing  estimated  is  used  as  a guide  to  planning. 

As  with  all  forecasts  and  most  goals,  unforeseen  developments  can 
alter  the  predicted  cource  of  events.  However,  until  such  time,  the  outline 
depicted  in  Figure  3-3  represents  the  most  reasonable  forecast  of  the  course 
that  information  processing  technology  will  take  through  the  next  several 
decades. 
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Figure  3-3.  Tline-Aiased  Goals  and  Supporting  Events 


Figure  3-3.  (Continued) 


TABU’  A-1  . TKCIINOLOCY 


I 

1 

I 


I'VliNT 

! Bir 

Importance 

Timing 

Most  Desirable  and  Most  Feasible 

• 

1 

1 

1.  Most  technical  information 

6 1 5 

59% 

1983 

retrieval  by  dial-up  communica- 

1 

1986  M 

tion  lines 

1 

1 

1990 

2,  Facsimile  transmission  competi- 

1 

13  1 10 

50% 

1981 

tive  with  postal  service  in  cost 

1 

1987  M 

• 

1 

• 

1995 

3.  Paper  will  be  replaced  as  prim- 

17c  1 14c 

77% 

1981 

ary  numeric  storage  medium  by 

1 

1988  M 

digital  media 

1 

1 

1995 

4.  OCR  able  to  convert  any  docu- 

19  ; NA 

70% 

1980 

ment  to  machine  readable  form 

1 

1 

1989  M 

1 

1 

1 

2050 

5.  Word  processing  equipment  making 

20  i 19 

68% 

1981 

available  machine  readable  full 

1 

1 

1985  M 

text 

• 

1 

1 

1994 

Moat  Desirable  and  Moderately 

1 

1 

• 

Feasible 

1 

1 

I 

6.  Machine  readable  storage  media 

2 i 3 

70% 

1982 

competitive  with  paper 

t 

1 

1990  M 

• 

• 

1 

2071 

7.  Files  electronically  transferred 

7 j 6 

68% 

1982 

between  different  locations  at 

1 

1 

1989  M 

low  cost 

1 

1 

1 

1996 

8,  Comnercial  software  packages 

21  i 20 

46% 

1983 

replacing  most  original  soft- 

1 

1 

1987  M 

ware  development 

1 

1994 

9.  Most  packaged  software  machine 

22  i NA 

66% 

1983 

independent 

1 

1990  M 

1 

1 

2008 

Moderately  Desirable  and  Most 

1 

1 

1 

Feasible 

1 

1 

1 

Machine  readable  storage  com- 

3 j 4 

66% 

1982 

petitive  with  microfilm 

1 

1991  M 

1 

i 


S - < 1985 
M - 1985-1995 


L - > 1995 


TABLE  A-1.  TECHNOLOGY  (Continued) 


11.  Peripherals  with  minis  will 
take  over  many  automated  func- 
tions 

12.  Interactive  computer  terminals 
available  for  $500. 


13.  High  quality,  low  cost  micro- 
film reader-printer  avail- 
able 

14.  Paper  replaced  as  document 
storage  medium  by  microforms 


15.  Automatic  mcnitoring  built  in-  16 
to  retrieval  systems 


16.  Paper  replaced  as  numeric 
dissemination  medium  by 
digital  media 

Least  Desirable  and  Most  Feasible 


17.  Paper  virtually  replaced  as  a 
numeric  dissemination  medium 
by  microform 

Moderately  Desirable  And 
Moderately  Feasible 

18.  Associative  memories  commonly 
used  for  machine-aided  fact 
retrieval 

19.  "Personal"  interactive  termin- 
als very  common 


20.  Paper  replaced  as  document 
storage  medium  by  full  text 
digital  media 


KVKNT 

21.  Acceptable  machine  generated 
index  data 


22.  Tutorial  features  of  on-line 
systems  making  intermediaries 
unnecessary 


Moderately  Desirable  and 


Least  Feasible 


23.  Associative  memories  will  be 
commonly  used  in  machine 
aided  retrieval 


Least  Desirable  and 
Moderately  Feasible 


24.  Paper  replaced  as  document 

dlnseminatlon  medium  by  micro- 
form 


25.  Paper  replaced  as  numeric 
storage  medium  by  microform 


Least  Desirable  and  Least  Feasible 

26.  Computers  designed  specifically 
for  bibliographic  storage  and 
retrieval 

27.  Paper  replaced  as  document  dis- 
semination medium  by  full  text 
digital  media 


TABLE  A-2.  ORGANIZATIONAL  AFFILIATION 


Most  Desirable  and  Most  Feasible 


28.  Standardized  citation  formats 


29.  Standardized  abstracts  formats 


Most  Desirable  and  Moderately 
Feasible 

30.  Standardized  user  protocols 
for  on-line  retrieval  system 


Moderately  Desirable  and  Most 
Feasible 

31.  Two  levels  of  Information 
providers  - wholesalers/ 
retailers 

Moderately  Desirable  and 
Moderately  Feasible 

32.  Unnecessary  data  base  dupllca> 
tlon  eliminated 


Moderately  Desirable  and 
Least  Feasible 

33.  Standardization  allowing  user 
organizations  to  merge  data 
bases  Into  a single  file 

Least  Desirable  and 


Moderately  Feasible 


34.  Decentralized  Input  processing 
for  large  IS&R  systems 


Timin 


1983 

1989  M 
2000+ 


1987 

2000+  L 
2000+ 


1981 

1988  M 
2000 


L9i 

> 


TABLE  A- 3.  ECONOMICS  AND  MARKETING 


Importance  I Timin 


Most  Desirable  and  Most  Feasible 


36.  Facsimile  transmission  com- 
petitive with  postal  service 
In  cost 

Moderately  Desirable  and 
Most  Feasible 

37.  Interactive  computer  terminals 
available  for  less  than  $500 


38.  High  quality,  low  cost  micro-  12 
film  reader-printer  available 


Least  Desirable  and  Least  Feasible 

39.  Federal  technical  information 
services  to  become  self-sup- 
porting 


TABLE  A-4.  SERVICES 


kvi^a'i: 


Most  Desirable  and  Most  Feasible 

40.  Accessibility  of  many  data 
bases  through  a single 
terminal 


Most  Desirable  and  Moderately 
Feasible 

41.  Major  IS&R  systems  allowing 
choice  of  output 


42.  Researchers  have  access  to 
data  bases  of  factual,  veri- 
fied data 

Moderately  Desirable  and  Moat 
Feasible 

43.  Interactive  access  to  citatior 
data  bases  replacing  abstracts 
and  indexes  as  searching  tools 

Moderately  Desirable  and 
Moderately  Feasible 


44.  Personal  interactive  terminals 
very  common 


45.  Tutorial  features  of  on-line 
systems  making  intermediaries 
unnecessary 

46.  Interactive  access  to  full 
text  data  bases  replacing 
abstracts  and  indexes  as 
searching  tools 

Moderately  Desirable  and  Least 
Feasible 

47.  Information  synthesis  and 
analysis  available  to  all 

_ researchers 


S » < 1985 
M - 1985-1995 


L - > 1995 


TABLE  A-4.  SERVICES  (Continued) 


KVKN'l' 

M?  ! U/^ 

Importance 

Timing 

Least  Desirable  and  Moderately 

1 

1 

• 

1 

Feasible 

1 

48.  Processing  of  numeric  data 

26  1 29 

44% 

1980 

at  least  equal  to  .the  pro* 

1 

1985  M 

cessing  of  bibliographic 

1 

1989 

Information 

Least  Desirable  and  Least  Feasible 

1 

1 

1 

49.  Dissemination  of  full  text 

1 

i 25a 

36% 

1986 

of  documents  precluding  need 

• 

1993  M 

for  abstracts  as  announce- 

1 

2004 

ment  devices 

1 

t 

1 

50.  Dissemination  of  full  text 

I 25b 

50% 

1985 

of  documents  precluding  need 

1 

1 

1991  M 

for  abstracts  as  retrieval 

1 

1 

1998 

devices 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

t 

1 

1 

1 

1 

1 

! 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

• 

1 

1 

1 

1 

1 

t 

1 

1 

1 

1 

TABLE  A- 5.  RANKED  ORDER  OF  IMPORTANCE 


( 


RANKING  BY  EVENT  NUMBER  EVENTS  BY  RANK  OF  IMPORTANCE 


TABLE  A"6.  DISTRIBUTION  OF  EVENTS  SY  ORDER  OF  IMPORTANCE 


Number  of  Events 
1 
1 
9 

15 

8 

9 

6 
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still  dropping,  and  CPU  handling  costs  are  still  in  flux.  3)  Physically  transporting  magnetic  tape 
or  a hologram  will  always  be  cheaper  than  electromagnetic  propagation.  The  answer  depends  on  distance. 
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1)  Whose  standards?  Such  standards  might  limit  future  advances.  2)  Political  pressure  would  have  to 
effect  this. 
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1)  Does  "competitive"  attach  a $ value  to  time?  Makes  a big  difference.  2)  Highly  desirable  when 
speed  is  important.  More  important  for  numeric;  less  important  for  bibliographic.  3)  For  many 
purposes,  this  would  be  a major  event  unless  mail  service  deteriorates  to  the  pony  express  level! 

4)  But  for  shorter  records,  more  feasible  and  sooner! 
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8)  Assume  "most"  enough  to  make  global  system 
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role,  so  terminal  not  necessary.  For  teleconferencing,  its  a different  matter.  Even  here  access 
to  a terminal  may  be  sufficient.  6)  But  why  purchase?  Most  R&D  people  will  have  access  to  the 
employer-supplied  terminal  selling  for  less  than  $500  (or  the  equivalent  in  rental).  7)  Cost  to 
manufacturer  is  a cinch.  Price  another  matter. 


electric  typewriters  themselves.  3)  More  important  that  they  be  niuch  more  widespread! 
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tronically  linked  so  that  a user  of 

one  of  these  data  bases  can  with  pro-  14  re  i jonsei  2 "now"  response 

authorization,  directly  access  almost 
other  data  base  through  a single  ; 

.ine  terminal. 
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1)  The  abstract  is  necessary  and  desirable  in  "screening"  for  relevancy,  irrespective  of  availability 
of  full  text.  2)  Will  always  be  a need  for  pre-digested  forms  of  a docuaient.  3)  We  could  drown 
in  the  information  overload.  4)  Unlikely  because  of  resultant  mountain  of  material.  5)  Abstracts 
will  continue  to  serve  as  effective  announcement  device.  6)  Don't  think  full  text  can  be  an 
"announcement  device"  7)  May  come  about  because  of  ignorance. 
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servic.  ..  Does  not  seem  as  relevant  to  numeric  data  base  services.  2)  As  yet  not  knovn  if  NASIC-like 
groups  will  remain  as  third  tier.  3)  I don’t  think  this  is  exactly  the  way  things  will  go.  4)  In 
U.S.  only.  5)  There  is  much  evidence  of  this  now.  Am  I missing  something  here? 
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TECHNOLOGY 


Question: 

Can  DDC  obtain  a computer  system  which  Is  specially 
designed  for  IS&R? 

Event : 

Computers  designed  specially  for  bibliographic  storage 
and  retrieval  applications  will  be  available. 

Question: 

Will  the  digital  storage  medium  become  competitive  with 
paper  and  microforms? 

Event : 

Machine-readable  storage  media  will  be  competitive  from 
cost,  capacity,  and  access  time  standpoints,  with: 

(a)  paper 

(b)  microform 

Question: 

Can  associative  memories  be  used  for  machine-aided 
Information  analysis  and/or  retrieval? 

Event : 

Associative  memories  will  be  commonly  available  for 
use  In  machine-aided 

• 

(a)  retrieval 

(b)  information  analysis 

Question: 

Is  DDC's  decision  to  pursue  dial-up  access  to  unclassi- 
fied information  sound? 

Event : 

85%  of  remote  technical  Information  retrieval  will  be 
accomplished  via  dial-up  (public  switched)  communica- 
tions lines.  The  remainder  will  be  accomplished  through 
dedicated  lines. 

Question: 

Can  entire  data  files  be  electronically  transferred 
between  DDC,  NTIS,  lAC's,  users,  etc? 

Event: 

Files,  (of  the  size  equivalent  to  a reel  of  magnetic 
tape)  will  be  electronically  transferred  directly 
from  one  data  base  to  another  at  a transmission  cost 
which  Is  competitive  with  mailing  a reel  of  tape. 

Question: 

Will  the  trend  be  away  from  large,  centralized  pro- 
cessing systems  and  toward  distributed  processing 
with  minicomputers? 

Event : 

Processing  In  large  scientific  Information  systems 
will  be  performed  by  a network  of  decentralized  mini- 
computers rather  than  by  large,  centralized  computers . 

A 
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Quest:  Ion ; 

Will  computers  be  able  to  support  a sufficient 
number  of  terminals  to  provide  a CRT  to  each  user 
who  wants  one? 

Event : 

Increased  computer  capac'ties  and  reduced  processing 
costs  will  allow  each  R&O  professional  to  have  his 
own  on-line  interactive  terminal. 

Question : 

What  factors  will  influence  the  acceptability  of 
microforms? 

Event : 

A high-quality,  low  cost  (i.e.,  under  $100)  microfilm 
reader-printer  will  be  comnercially  available. 

Event : 

Microforms  will  become  equal  to  paper  in  acceptability 
by  information  users. 

Que  s 1 1 on : 

What  are  the  alternatives  to  the  postal  service  for  docu- 
ment delivery? 

Event : 

Facsimile  transmission  will  be  competitive  with  postal 
service  for  full  text  document  delivery  in  terms  of 
cost  and  speed. 

Question ; 

Will  paper  cease  to  be  the  primary  document  storage 
and  dissemination  medium? 

Event : 

Paper  will  be  replaced  as  the  primary  document  dis- 
semination and  storage  medium  by; 

(a)  Microforms 

(b)  Full  text  digital  media 

(c)  Sound  recordings 

(d)  Other  (specify) 

Question; 

How  can  DOC  get  user  feedback  without  reinitiating  user 
surveys  every  year? 

Event : 

Automatic  retrieval  systems  will  have  built  in  monitor- 
ing features,  thus  providing  instant  analysis  of  system 
use  and  user  needs. 

Question; 

Will  paper  cease  to  be  the  primary  document  storage 
and  dissemination  medium  for  numeric  data? 

Event ; 

Paper  will  be  replaced  as  the  primary  numeric  data 
storage  and  dissemination  medium  by; 

(a)  Microforms 

(b)  Digital  media 

(c)  Sound  Recordings 

(d)  Other  (specify) 

AuonucH 


Question: 


Should  DDC  continue  to  support  machine-aided  Indexing 
activities? 


Event : 

For  scientific  and  technical  report  literature,  the 
generation  of  acceptable  index  data  from  machine 
readable  text  will  virtually  eliminate  the  need  for 
manual  indexing. 

Question : 

Can  DDC  eliminate  duplicate  input  keyboarding? 

Event: 

Optical  character  recognition  devices  will  readily 
convert  any  document  to  machine-readable  form,  regard- 
less of  format  or  type  font. 

Event : 

Increased  use  of  word  processing  equipment  will  make 
machine  readable  versions  of  full  text  documents 
readily  available. 

Question : 

Can  DDC  minimize  original  software  development? 

Event : 

Use  of  commercially  available  software  packages  for 
document  storage  and  retrieval  applications  will 
virtually  replace  original  software  development. 

Question: 

Can  DDC  approach  a reasonable  degree  of  computer 
manufacturer  independence? 

Event: 

All  packaged  software  will  be  machine  independent. 

Question: 

Can  the  Defense  on-line  Retrieval  System  provide  full 
conversational  capability? 

Event : 

Conversational  and  tutorial  on-line  retrieval  systems 
will  evolve  to  the  point  where  human  intermediaries 
between  the  system  and  the  requester  become  unnecessary. 

ORGANIZATIONAL 

STRUCTURES  AND  AFFILIATIONS 

Question: 

C<in  DDC  minimize  overlap  and  duplication  between  its 
data  base  and  others? 

Event : 

Duplication  among  major  bibliographic  data  bases  will 
be  virtually  eliminated  through  Interorganizatlonal 
agreements . 

Question : 

Is  the  distributed  input  processing  concept  preferrable 
to  central  input  and  processing  at  DDC? 

Event : 

Input  of  information  to  large  IS&R  systems  (e.g.,  DDC, 

NTIS,  NASA,  etc.)  ill  be  decentralized,  with  abstract- 
ing, Indexing,  and  data  conversion  provided  at  the 
local  source  level. 

A 
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Question : 


Will  it  be  possible  to  merge  DDC  and  other  relevant 
data  bases? 


Event: 

It  will  be  possible  for  a user  organization  to  readily 
merge  available  scientific  and  technical  bibliographic 
data  bases  into  a single  file. 

Question; 

Should  DDC  adopt  a more  centralized  approach? 

Event : 

Through  ready  access  to  a central  Information  storage 
and  dissemina :ion  facilities,  userj  can  bypass  local 
information  oi  library  facilities  and  these  can  be 
eliminated . 

Question: 

What  should  be  the  relationship  between  DDC  and  its 
peers? 

E’  ent : 

Machine-readable  R6J)  data  bases  will  be  electronically 
linked  so  that  a user  of  any  one  of  these  data  bases 
can,  with  proper  authorization,  directly  access  any 
other  data  base  tijrough  an  on-line  terminal. 

Question: 

Is  a universally-adopted  Indexing  vocabulary  feasible? 

Event : 

A single  standard,  interdisciplinary  subject  indexing 
vocabulary  adopted  for  use  by  all  the  major  science 
information  services. 

Question : 

Is  a common,  standardized  citation  format  feasible  for 
all  technical  literature,  thus  allowing  free  exchange 
of  document  surrogates  among  information-handling 
agencies? 

Event : 

Common,  standardized  citation  formats  for  all  technical 
report  literature  will  be  adopted  by  all  scientific  and 
technical  information  services. 

Question: 

Is  a common,  standardized  abstract  format  feasible  for 
all  technical  literature  thus  allowing  free  exchange 
of  document  surrogates  among  information  handling 
agencies? 

Event : 

Common,  standardized  abstract  formats  for  all  technical 
report  literature  will  be  adopted  by  all  scientific  and 
technical  information  services. 

Question: 

Will  DDC  have  to  adopt  a standardized  protocol  for  DROLS? 

Event ; 


Standardized  user  protocols  for  on-line  Interactive 
retrieval  systems  will  be  adopted  by  all  technical 
information  services. 


Will  Federal  STINFO  services  be  consolidated  under  one 
or  more  umbrella  organisations,  causing  DDC  to  be 
merged  with  others? 

Virtually  all  Federal  technical  information  services 
will  be  merged  into  a central  organization. 


Question:  What  is  the  trade-off  between  DDC  performing  information 

processing  with  government  personnel  and  delegating 
these  activities  to  contractor  staff? 

Event:  Federal  agencies  will  employ  contractor  staff  to  perform 

virtually  all  of  their  information  processing  activities. 

111.  ECONOMICS  AND  MARKETING 

Question:  At  what  cost  will  DDC  be  able  to  supply  each  potential 

user  with  an  economical  interactive  terminal? 

Event;  Each  R&D  professional  will  be  able  to  purchase  an 

interactive  computer  terminal  for  less  than  $500. 


Question;  To  what  extent  will  DDC  need  to  become  self  supporting? 

Event:  Federal  technical  information  processing  and  semina- 

tion activities  will  become  virtually  self-supporting. 

IV,  SCOPE  OF  SERVICES  • 

Que.stion:  Can  DDC  and/or  its  users  electronically  tap  into  other 

relevant  data  bases? 


Event:  Using  a single  terminal,  each  R&D  professional  will  be 

able  to  query  any  bibliographic  or  numeric  data  base 
of  his  choice. 


Question: 

Should  DDC  continue  to  publish  its  abstract  Journal 
(TAB)  in  paper  form? 

Event : 

In  an  R&D  environment,  interactive  on-line  access  to 
bibliographic  data  bases  will  virtually  (i.e.,  90%+) 
replace  the  traditional  abstracting  and  indexing 
journal  in  paper  form  as  literature  searching  tools. 

Question: 

Will  cheap  and  rapid  document  dissemination  techniques 
preclude  the  need  for  dissemination  of  abstracts? 

Event;  Low  cost,  rapid  dissemination  of  full  text  of  documents 

will  preclude  the  need  for  abstracts  as  document  announce- 
ment and  retrieval  devices. 


Question: 


Event : 


A 
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Question: 

Should  DDG  direct  its  efforts  toward  subscription  and 
away  from  demand  services? 

Event : 

Automatic  delivery  (as  opposed  to  delivery  upon  demand) 
of  information  products  such  as  documents  and  citations 
will  become  the  rule;  request  services  will  become  the 
exception. 

Question: 

How  far  should  DDC  go  in  providing  tailored  services 
to  its  users? 

Event : 

All  major  RfO  Information  systems  will  permit  the  user 
to  specify  his  own  output  format,  with  virtually  no 
limitations  on  data  order  or  structure. 

Question: 

Should  DDC  be  wholesaling  services  to  local  libraries 
retailing  services  to  individual  users,  or  both? 

Event : 

Two  tiers  of  Information  providers  will  emerge  and  be 
clearly  definable:  those  large  information  services 

which  wholesale  their  products  to  local  libraries  and 
service  centers;  and  local  activities  which  "retail" 
their  products  directly  to  end  users. 

Question: 

Is  the  lAC  concept  viable? 

Event : 

All  R&D  personnel  will  have  the  option  of  requesting 
detailed  analysis  and  synthesis  of  the  literature  of 
their  discipline  through  an  established  service,  such 
as  an  information  analysis  center. 

Question: 

Will  numeric  data  collection,  storage  and  retrieval 
become  a major  DDC  service? 

Event : 

In  the  R&D  environment,  the  collection,  storage,  and 
retrieval  of  numeric  data  will  at  least  equal,  if  not 
surpass,  in  volume  and  importance,  the  processing  of 
bibliographic  information. 

Question: 

Should  DDC  provide  highly  select  data  bases  of  verified 
and  reproducible  research  results? 

Event : 

R&D  scientists  will  have  access  to  discipline  oriented 
data  bases  of  highly  select,  certified  and  validated 
numerical  data  as  opposed  to  bibliographic  references 
to  reported  results  and  data  bases  of  unverified  data. 
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TABLE  E-1.  MOST  DESIRABLE  AND  MOST 
FEASIBLE  EVENTS 


EVENT 


TECHNOLOGY 

• Most  technical  Information  retrieval  will  be  accomplished  by 
dial-up  communications  lines 

• Facsimile  transmission  will  be  competitive  with  postal  service 
In  cost 

• Paper  will  be  replaced  as  primary  numeric  storage  medium  by 
digital  media 

a OCR  will  be  able  to  convert  any  document  to  machine-readable 
form 

e Word  processing  equipment  making  available  machlne-reedable 
full  text 


ORGANIZATIONAL  AFFILIATIONS 


• Standardised  citation  formats 

• Standardised  abstract  formats 


ECONWICS 

• Facsimile  transmission  competitive  with  postal  service  In 
cost 


SERVICES 


• Many  data  bases  accessible  through  a single  terminal 


TABLE  E-2.  MOST  DESIRABLE  AND  MODERATELY 
FEASIBLE  EVBWTS 


EVENT 


TECHNOLOGY 


• Machine  readable  storage  media  competitive  with 
paper 

• Files  electronically  transferred  between  different  locations 
at  low  cost 

• Commercial  software  packages  replacing  most  original 
software  development 

• Most  packaged  software  machine  independent 


ORGANIZATIONAL  STRUCTURES  AND  AFFILITATIONS 

• Standardised  user  protocols  for  on-line  retrieval  systems 


SERVICES 

• Major  IS&R  systems  allowing  choice  of  output 

• Researchers  have  access  to  data  bases  of  " .actual" 
verified  numeric  data 


TABLE  F-3.  MOST  .SASIBLE  AND  MODEPATELY 
DESIRABLE  EVENTS 


EVENT 

TECHNOLOGY 

• Machine-readable  storage  competitive  with  microform 

• Peripherals  with  mini's  will  take  over  many  automated 
functions 

• Interactive  computer  terminals  available  for  less  than 
$500 

• High  quality,  low  cost  microfilm  reader-printer  available 

• Paper  replaced  as  document  storage  medium  by  microforms 

• Automatic  monitoring  built  Into  retrieval  systems 

• Paper  replaced  as  numeric  dissemination  medium  by  full-text 
digital  media 

ORGANIZATIONAL  AFFILIATIONS 

• Two  levels  of  Information  providers:  "wholesalers"  and 

"retailers" 

ECONOMICS 

• Interactive  computer  terminals  available  for  less  than  $500 

• High  quality,  low  cost  microfilm  reader-printer  available 

SERVICES 


Interactive  access  to  citation  data  bases  replacing  abstracting 
and  Indexing  tools 


TABLE  MOST  FEASIBLE  AND  LEAST  DESIRABLE  EVENTS 


EVENT 

A.  TECHNOLOGY 

• Paper  virtually  replaced  as  a dissemination  medium  by 
microform 


TABLE  E -5.  MO’  RATELY  DESIRABLE.  MODERATELY 
J^SIBLE  EVENTS 


EVENT 

A.  TECHNOLOGY 

• Associative  memories  commonly  used  for  machine-aided  fact 
retrieval 

• "Personal"  Interactive  terminals  very  common 

• Paper  replaced  as  document  storage  medium  by  full  text  digital 
media 

e Acceptable  machine-generated  Index  data 

e Tutorial  features  of  on-line  systems  making  Intermediaries 
unnecessary 

B.  ORGANIZATIONAL  AFFILIATIONS 

• Unnecessary  data  base  duplication  eliminated 

C.  SERVICES 

a "Personal"  Interactive  terminals  very  common 

• Tutorial  features  of  on-line  systems  making  Intermediaries 
unnecessary 

• Interactive  access  to  full  text  data  bases  replacing  abstract- 
ing and  Indexing  as  searching  tools 


TABLE  E -6.  MODERAmY  DESIRABLE  AND 
LEAST  FEASIBLE  EVENTS 


EVENT 

TECHNOLOGY 


• Associative  memories  will  be  commonly  used  in  machine-aided 
retrieval 


ORGANIZATIONAL  AFFILIATIONS 


• Standardization  allowing  user  organizations  to  merge  data 
bases  onto  a single  file 


SERVICES 


• Information  synthesis  and  analysis  available  to  all  researchers 


TABLE  E-7.  MODERATELY  FEASIBLE  AND 
LEAST  DESIRABLE  EVENTS 


EVENT 

TECHNOLOGY 

• Paper  replaced  as  document  dissemination  medium  by  full-text 
microform  media 

e Paper  replaced  as  numeric  storage  medium  by  microforms 

organizational  affiliations 

e Decentralized  input  processing  for  large  IS&R  systems 

SERVICES 

e 


Processing  of  numeric  data  at  least  equalling  the  processing  of 
bibliographic  information 


TAB.E  E~8.  least  DESIRABLE  AND 
LEAST  FEASIBLE  EVENTS 


EVENT 


A.  TECHNOLOGY 


• Conputeri  designed  specifically  for  bibliographic  storage 
and  retrieval 

• Paper  replaced  as  document  dissemination  medium  by  full-text 
digital  media 


B.  ORGANIZATIONAL  AFFILIATIONS 


• One  Interdisciplinary  subject  vocabulary 


C.  ECONOMICS 


• Federal  technical  Information  services  self-supporting 


D.  SERVICES 


• Dissemination  of  full  text  of  documents  precluding  need  for 
abstracts  as  announcement  devices 

• Dissemination  of  full  text  of  documents  precluding  need 
for  abstracts  as  retrieval  devices 


